-- Logs begin at Fri 2022-08-26 14:52:36 UTC, end at Fri 2022-08-26 16:18:17 UTC. -- Aug 26 15:47:41.605623 dv-cinder-851449-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 26 15:47:41.620129 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 26 15:47:41.622099 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 26 15:47:41 2022] *** Aug 26 15:47:41.622099 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 26 15:47:41.622099 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 26 15:47:41.622099 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: nodename: dv-cinder-851449-7-iscsi Aug 26 15:47:41.622099 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: machine: x86_64 Aug 26 15:47:41.622099 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: clock source: unix Aug 26 15:47:41.622099 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: pcre jit disabled Aug 26 15:47:41.622099 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: detected number of CPU cores: 4 Aug 26 15:47:41.622099 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: current working directory: / Aug 26 15:47:41.622099 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: detected binary path: /usr/bin/uwsgi-core Aug 26 15:47:41.622689 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: your processes number limit is 47680 Aug 26 15:47:41.622689 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: your memory page size is 4096 bytes Aug 26 15:47:41.622689 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: detected max file descriptor number: 2048 Aug 26 15:47:41.622689 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: lock engine: pthread robust mutexes Aug 26 15:47:41.622689 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: thunder lock: enabled Aug 26 15:47:41.622689 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 26 15:47:41.622689 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 26 15:47:41.661960 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: Python main interpreter initialized at 0x5573412b89c0 Aug 26 15:47:41.661960 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: python threads support enabled Aug 26 15:47:41.661960 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: your server socket listen backlog is limited to 100 connections Aug 26 15:47:41.661960 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: your mercy for graceful operations on workers is 90 seconds Aug 26 15:47:41.662374 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: mapped 403077 bytes (393 KB) for 2 cores Aug 26 15:47:41.662374 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: *** Operational MODE: preforking *** Aug 26 15:47:41.662649 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: *** uWSGI is running in multiple interpreter mode *** Aug 26 15:47:41.662649 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: spawned uWSGI master process (pid: 112863) Aug 26 15:47:41.662863 dv-cinder-851449-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 26 15:47:41.664303 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: spawned uWSGI worker 1 (pid: 112864, cores: 1) Aug 26 15:47:41.664303 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: spawned uWSGI worker 2 (pid: 112865, cores: 1) Aug 26 15:47:41.664303 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 26 15:47:42.343663 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 15:47:42.347494 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 15:47:43.440400 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 15:47:43.440400 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: from cryptography.utils import int_from_bytes Aug 26 15:47:43.441111 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 15:47:43.441111 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: from cryptography.utils import int_from_bytes Aug 26 15:47:43.442636 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 15:47:43.442636 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: from cryptography.utils import int_from_bytes Aug 26 15:47:43.443135 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 15:47:43.443135 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: from cryptography.utils import int_from_bytes Aug 26 15:47:45.932460 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 15:47:45.933077 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 15:47:45.933206 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 15:47:45.933566 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 15:47:45.933817 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 15:47:45.934203 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.934521 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.934836 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.935174 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.935501 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.935687 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 15:47:45.936111 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.936253 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 15:47:45.936385 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.936385 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.936625 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 15:47:45.936746 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.936873 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 15:47:45.936993 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.937133 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 15:47:45.937252 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.937440 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.937836 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851449-7-iscsi {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.937966 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.938093 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.938222 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.938335 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.938466 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.938589 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.938706 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.938847 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.939025 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.939146 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.939331 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.939485 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.939629 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.939762 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.939959 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.940123 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.940282 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.940532 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.940671 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.940842 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.940962 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851449-7-iscsi {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.941148 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.941263 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.941454 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.941591 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.941957 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.942188 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.942188 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.942461 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.942592 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.942777 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.942904 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.943060 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.943191 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.943318 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.943477 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.943608 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.943767 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851449-7-iscsi {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.943894 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.944036 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.944169 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.944311 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.944443 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.944571 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.944753 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.944934 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.945057 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.945232 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.945348 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.945529 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.945754 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.945943 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.946136 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.946267 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.946397 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.946573 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.946729 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.946873 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.947154 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851449-7-iscsi {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.947844 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.948029 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.948209 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.948379 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.948552 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.948749 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.948932 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.949106 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.949279 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.949477 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.949779 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.949962 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.950160 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.950511 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.950689 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.950874 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.951096 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.951275 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.951464 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.951645 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.951824 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.952008 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.952206 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.952389 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.952584 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.952775 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.952775 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.953094 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.953257 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.953430 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.953598 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.953724 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.953846 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.953977 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.954096 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.954214 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.954331 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.954449 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.954567 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.954701 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.954817 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.955003 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.955141 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.955260 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.955389 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.955513 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.955632 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.955760 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.955878 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.955997 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.956189 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.956310 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.956433 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.956570 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.956692 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.956821 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.956947 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.957065 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.957185 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.957304 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.957304 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.957536 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.94 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.957655 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.957788 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.94 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.957907 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.958026 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.958154 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.958282 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.958413 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.958543 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.958661 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.958789 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.959004 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.959150 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.959278 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.959405 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.959530 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.959648 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.959790 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.959911 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.960040 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.960170 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.960297 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.960426 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.960749 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.94 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.960871 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.961003 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.94 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.961003 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.961229 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.961354 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.961483 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.961608 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.961727 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.961855 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.961973 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.962099 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.962278 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.962400 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.962583 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.962757 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.963008 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.963161 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.963387 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.963570 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.963698 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.963817 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.963941 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.964076 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.964230 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.964352 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.964537 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.964658 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.964840 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.964974 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.965181 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.965303 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.965506 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.965640 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.965791 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.965924 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.966092 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.966211 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.966392 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.966524 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.966689 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.966834 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.967007 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.967144 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.967314 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.967435 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.967611 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.967731 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.967910 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.968049 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.968211 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.968339 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.968514 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.968643 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.968810 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.968938 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.969109 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.969229 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.969412 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.969532 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.969710 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.969829 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.970007 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.970127 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.970318 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.970439 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.970949 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.971112 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.971234 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.971355 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.971562 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.971690 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.971818 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.971936 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.972066 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.972185 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.972361 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.972494 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.972664 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.972786 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.972965 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.973087 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.973260 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.973382 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.973565 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.973714 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.973845 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.973966 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.974138 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.974260 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.974440 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.974562 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.974736 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.974877 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.975054 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.975188 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.975364 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.975485 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.975667 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.975802 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.975967 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.976087 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.976266 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.976439 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.976568 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.976702 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.976857 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.976979 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.977163 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.977290 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.977466 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.977602 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.977772 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.977893 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.978074 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.978195 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.978445 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.978648 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.978867 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.979017 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.979144 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.979284 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.979416 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.979551 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.979670 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.979807 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.979971 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:47:45.980104 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.980311 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.980433 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.980647 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.980769 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.981053 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.981197 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.981336 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.981469 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.981602 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.981726 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.981912 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.982048 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.982228 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.982351 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.982544 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.982667 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.982859 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.983027 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.983215 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.983377 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.983510 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.983650 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.983833 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.984014 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.984166 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.984317 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.984467 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.984615 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.984777 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.984937 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.985088 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.985238 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.985388 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.985545 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.985732 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.985893 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.986044 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.986213 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.986365 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.986489 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.986649 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.986817 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.987035 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.987216 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.987366 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.987515 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.987675 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.987835 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.987984 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.988135 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.988285 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.988434 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.988593 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.988741 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.988908 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.989058 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.989208 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.989356 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.989520 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.989669 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.989819 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.989966 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.990114 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.990263 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.990428 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.990577 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.990737 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.990886 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.991059 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.991305 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.991459 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.991609 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.991758 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.991907 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.992056 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.992213 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.992371 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.992520 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.992669 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.992835 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.992986 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.993251 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.993374 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.993550 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.993714 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.993835 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.994546 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.994815 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.995018 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.995182 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.995303 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.995425 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.995558 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.995679 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.995886 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.996042 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.996171 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.996295 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.996431 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.996551 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.996721 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.996842 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.996961 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.997080 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.997217 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.997335 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.997468 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.997589 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.997715 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.997841 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.997971 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.998090 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.998208 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.998328 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.998453 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.998602 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.998736 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.998950 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.999081 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.999265 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.999386 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.999609 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.999788 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:45.999916 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.000036 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.000247 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.000413 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.000579 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.000731 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.000881 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.001053 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.001204 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.001412 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.001582 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.001733 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.001733 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.002017 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.002165 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.002314 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.002478 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.002637 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.002788 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.002976 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.003152 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.003324 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.003480 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.003629 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.003792 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.003943 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.004092 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.004251 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.004401 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.004549 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.004549 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.004858 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.005019 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.005189 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.005348 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.005499 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.005499 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.005781 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.005932 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.006092 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.006242 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.006393 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.006542 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.006703 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.006875 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.007076 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.007226 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.007376 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.007525 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.007674 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.007839 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.007990 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.008140 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.008289 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.008449 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.008598 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.008757 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.008908 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.009077 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.009244 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.009395 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.010241 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.010507 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.010669 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.010822 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.011003 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.011159 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.011325 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.011448 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.011575 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.011794 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.011970 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.012131 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.012292 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.012444 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.012604 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.012763 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.012914 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.013065 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.013226 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.013394 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.013566 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.013719 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.013872 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.014035 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.014196 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.014355 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.014514 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.014665 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.014816 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.015069 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.015225 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.015386 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.015536 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.015694 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.015851 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.016010 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.016171 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.016326 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.016478 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.016628 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.016777 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.016936 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.017106 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.017257 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.017406 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.017557 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.017708 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.017866 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.018028 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.018178 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.018328 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.018478 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.018643 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.018793 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.018980 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.019145 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.019305 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.019456 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.019618 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.019769 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.019929 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.020092 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.020244 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.020363 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.020543 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.020698 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.020848 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.021007 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.021173 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.021324 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.021520 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.021747 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.021926 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.022081 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.022245 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.022398 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.022562 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.022716 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.022870 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.023044 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.023196 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.023436 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.023603 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.023765 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.023918 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.024069 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.024221 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.024393 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.024546 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.024697 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.024849 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.025001 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.025144 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.025296 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.025505 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.025659 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.025932 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.026088 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.026088 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.026404 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.026576 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.026729 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.026852 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.027080 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.027243 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.027395 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.027545 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.027710 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.027860 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.028020 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.028185 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.028343 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.028510 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.028661 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.028812 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.028962 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.029122 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.029272 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.029421 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.029569 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.029717 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.029874 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.030034 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.030185 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.030333 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.030474 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.030655 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.030813 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.031003 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.031161 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.031314 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.031475 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.031633 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.031787 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.031914 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.032136 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.032287 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.032439 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.032613 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.032774 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.032935 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.033087 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.033239 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.033390 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.033540 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.033673 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.033854 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.034019 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.034174 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.034338 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.034501 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.034665 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.034819 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.035008 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.035160 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.035312 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.035502 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.035659 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.035819 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.035969 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.036127 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.036283 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.036441 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.036592 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.036752 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.036902 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.037051 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.037207 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.037367 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.037526 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.037684 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.037684 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.037977 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.038137 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.038288 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.038438 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.038605 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.038763 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.038945 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.039130 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.039289 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.039443 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.039603 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.039755 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.039906 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.040096 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.040249 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.040402 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.040575 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.041288 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.041645 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.041645 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.041886 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.042014 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.042137 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.042259 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.042395 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.042525 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.042656 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.042776 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.042902 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.043087 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.043281 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.043429 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.043570 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.043691 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.043825 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.043945 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.044063 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.044192 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.044311 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.044429 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.044557 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.044677 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.044796 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.044796 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.045039 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.045158 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.045277 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.045394 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.045394 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.045636 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.045803 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.045922 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.046082 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.046203 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.046322 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.046453 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.046574 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.046693 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.046823 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.046985 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.047108 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.047243 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.047435 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.047555 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.047676 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.047796 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.047916 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.048036 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.048176 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.048297 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.048417 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.048550 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.048679 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.048809 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.048938 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.049058 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.049179 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.049300 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.049419 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.049548 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.049668 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.049789 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.049925 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.050045 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.050173 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.050304 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.050422 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.050573 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.050694 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.050866 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.051017 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.051147 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.051266 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.051386 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.051520 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.051639 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.051770 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.051897 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.052029 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.052206 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.052329 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.052450 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.052581 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.052702 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.052822 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.052942 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.053061 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.053182 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.053369 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.053548 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.053678 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.053806 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.053965 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.053965 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.054269 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.054400 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.054521 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.054640 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.054768 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.054906 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.055098 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.055231 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.055350 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.055469 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.055587 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.055722 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.055887 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.056015 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.056134 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.056314 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.057020 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.057352 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.057475 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.057694 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.057839 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.058007 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.058146 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.058311 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.058461 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.058628 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.058779 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.058947 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.059124 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.059248 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.059444 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.059567 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.059755 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.059878 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.060071 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.060195 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.060385 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.060516 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.060705 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.060829 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.061000 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.061116 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.061304 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.061428 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.061605 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.061738 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.061913 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.062035 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.062220 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.062364 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.062516 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.062649 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.062824 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.063012 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.063167 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.063292 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.063477 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.063661 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.063782 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.063905 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.064058 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.064182 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.064356 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.064490 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.064657 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.064779 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.064959 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.065092 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.065264 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.065384 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.065566 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.065686 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.065865 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.065988 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.066165 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.066297 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.066465 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.066588 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.066763 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.066884 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.067109 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.067228 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.067414 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.067535 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.067715 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.067847 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.068121 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.068247 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.068368 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.068500 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.068642 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.068773 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.068943 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.069065 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.069249 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.069378 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.069557 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.069689 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.069866 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.069988 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.070180 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.070310 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.070486 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.070622 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.070793 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.070947 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.071143 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.071284 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.071413 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.071543 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.071707 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.071828 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.072053 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.072188 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.072368 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.072566 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.072701 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.072904 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.073104 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.073238 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.073437 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.073586 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.073774 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.073895 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.074015 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.074149 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.074283 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.074449 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.074579 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.074760 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.074881 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.075077 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.075275 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.075397 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.075532 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.075677 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.075800 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.075984 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.076117 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.076290 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.076412 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.076596 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.076718 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.076905 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.077035 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.077215 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.077338 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.077524 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.077646 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.077831 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.077951 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.078137 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.078265 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.078439 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.078569 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.078745 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.078877 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.079079 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.079204 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.079381 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.079505 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.079700 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.079824 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.080008 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.080132 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.080311 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.080445 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.080618 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.080752 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.080918 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.081042 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.081225 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.081360 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.081510 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.081645 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.081828 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.081952 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.082145 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.082281 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.082467 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.082614 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.082779 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.082915 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.083111 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.083262 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.083422 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.083559 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.083843 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.083967 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.084104 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.084239 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.084359 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.084493 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.084613 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.084735 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.084933 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.085058 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.085245 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.085367 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.085555 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.085678 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.085869 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.085991 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.086165 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.086296 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.086472 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.086595 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.086777 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.086907 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.087124 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.087255 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.087425 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.087562 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.087750 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.088069 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.088370 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.088723 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.088857 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.089049 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.089172 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.089375 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.089499 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.089699 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.089825 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.090027 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.090149 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.090352 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.090476 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.090667 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.090790 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.091069 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.091195 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.091395 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.091529 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.091715 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.091857 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.092019 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.092156 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.092329 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.092450 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.092671 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.092840 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.092994 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.093143 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.093293 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.093500 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.093706 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.093904 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.093904 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.094220 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.094220 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.094532 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.094698 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.094850 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.095036 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.095205 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.095357 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.095507 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.095915 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.096066 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.096229 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.096389 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.096549 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.096700 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.096850 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.097000 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.097160 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.097312 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.097475 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.097699 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.097861 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.098012 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.098178 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.098341 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.098491 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.098641 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.098791 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.098979 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.099117 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.099239 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.099471 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.099609 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.099729 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.099849 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.099982 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.100103 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.100235 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.100355 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.100475 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.100618 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.100738 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.100858 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.100979 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.101098 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.101228 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.101359 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.101526 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.101651 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.101772 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.101960 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.102081 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.102278 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.102401 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.102596 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.102785 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.102907 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.103081 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.103728 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.103891 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.104165 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.104432 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.104571 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.104708 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.104840 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.104960 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.105079 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.105200 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.105364 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.105501 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.105675 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.105806 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.105993 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.106123 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.106302 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.106440 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.106621 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.106751 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.106944 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.107068 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.107259 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.107391 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.107571 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.107706 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.107886 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.108007 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.108199 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.108320 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.108511 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.108631 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.108811 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.108934 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.109114 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.109237 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.109423 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.109545 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.109723 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.109855 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.110024 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.110157 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.110326 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.110462 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.110632 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.110754 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.110948 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.111090 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.111254 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.111375 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.111560 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.111714 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.111873 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.111997 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.112174 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.112297 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.112492 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.112626 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.112804 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.112951 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.113101 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.113225 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.113401 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.113536 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.113700 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.113824 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.114036 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.114222 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.114408 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.114543 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.114665 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.114786 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.115069 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.115194 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.115372 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.115494 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.115618 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.115739 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.115896 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.116018 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.116211 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.116336 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.116526 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.116655 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.116831 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.116957 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.117141 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.117274 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.117450 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.117572 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.117755 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.117885 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.118060 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.118182 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.118368 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.118490 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.118680 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.118814 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.119753 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.119902 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.120077 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.120211 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.120392 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.120527 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.120705 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.120830 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.121018 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.121143 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.121367 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.121502 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.121694 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.121831 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.121991 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.122115 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.122301 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.122437 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.122623 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.122754 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.122947 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.123092 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.123297 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.123429 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.123577 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.123701 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.123900 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.124022 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.124224 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.124364 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.124567 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.124699 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.124849 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.124984 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.125162 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.125285 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.125477 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.125601 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.125793 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.125927 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.126116 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.126239 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.126424 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.126665 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.126803 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.127036 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.127171 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.127336 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.127475 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.127655 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.127791 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.127966 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.128088 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.128279 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.128414 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.128591 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.128727 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.128900 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.129036 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.129206 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.129330 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.129517 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.129661 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.129827 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.129951 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.130148 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.130271 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.130481 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.130713 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.130842 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.131027 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.131149 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.131275 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.131423 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.131553 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.131705 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.131829 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.132055 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.132218 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.132356 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.132533 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.132723 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.132849 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.133045 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.133181 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.133359 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.133485 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.133679 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.133802 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.134001 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.134140 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.134319 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.134540 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.134728 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.134851 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.135041 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.135189 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.135355 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.135479 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.135670 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.135792 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.135974 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.136096 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.136292 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.136416 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.136601 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.136726 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.136927 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.137069 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.137220 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.137344 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.137527 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.137662 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.137930 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.138053 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.138257 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.138392 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.138577 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.138701 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.138899 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.139089 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.139321 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.139445 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.139634 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.139774 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.139939 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.140087 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.140260 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.140422 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.140547 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.140758 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.140882 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.141083 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.141206 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.141406 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.141529 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.141730 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.141863 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.142035 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.142172 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.142338 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.142463 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.142644 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.142767 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.142968 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.143095 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.143279 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.143422 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.143583 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.143723 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.143904 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.144038 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.144208 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.144345 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.144514 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.144648 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.144841 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.144976 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.145106 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.145350 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.145473 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.145687 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.145810 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.145989 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.146232 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.146371 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.146496 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.146623 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.146747 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.146872 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.147038 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.147188 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.147322 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.147491 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.147624 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.147800 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.147935 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.148102 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.148235 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.148409 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.148531 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.148761 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.148896 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.149073 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.149195 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.149371 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.149491 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.149674 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.149810 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.149984 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.150127 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.150313 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.150492 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.150628 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.150843 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.150992 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.151185 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.151307 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.151519 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.151660 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.151833 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.151957 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.152150 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.152386 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.152510 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.152714 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.152848 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.153030 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.153156 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.153355 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.153489 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.153668 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.153802 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.153969 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.154091 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.154275 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.154411 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.154583 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.154714 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.154897 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.155095 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.155226 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.155366 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.155573 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.155704 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.155828 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.155951 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.156144 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.156283 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.156452 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.156576 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.156761 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.156884 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.157073 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.157219 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.157375 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.157500 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.157680 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.157808 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.157985 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.158107 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.158292 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.158426 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.158600 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.158723 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.158906 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.159064 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.159234 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.159358 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.159544 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.159668 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.159881 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.160118 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.160243 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.160457 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.160579 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.160782 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.160905 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.161093 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.161217 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.161400 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.161533 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.161707 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.161944 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.162066 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.162202 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.162339 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.162476 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.162616 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.162740 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.162915 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.163094 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.163229 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.163374 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.163535 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.163659 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.163870 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.163992 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.164183 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.164319 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.164499 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.164624 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.164837 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.165024 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.165193 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.165328 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.165448 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.165572 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.166228 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.166369 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.166557 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.166678 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.166871 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.167017 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.167218 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.167358 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.167529 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.167657 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.167848 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.167972 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.168201 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.168327 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.168529 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.168654 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.168843 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.168965 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.169149 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.169286 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.169454 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.169580 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.169763 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.169888 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.170073 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.170209 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.170378 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.170502 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.170682 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.170815 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.171004 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.171144 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.171304 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.171438 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.171608 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.171741 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.171910 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.172050 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.172214 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.172337 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.172523 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.172670 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.172828 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.172971 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.173128 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.173254 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.173430 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.173564 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.173732 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.173865 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.174034 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.174190 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.174325 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.174507 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.174645 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.174841 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.175068 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.175193 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.175317 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.175499 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.175621 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.175822 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.175945 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.176123 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.176246 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.176423 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.176547 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.176752 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.176878 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.177072 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.177196 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.177521 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.177653 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.177779 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.177913 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.178044 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.178173 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.178306 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.178427 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.178594 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.178728 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.178901 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.179107 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.179230 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.179369 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.179536 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.179659 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.179840 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.179973 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.180149 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.180270 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.180459 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.180582 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.180767 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.180900 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.181072 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.181194 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.181410 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.181536 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.181776 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.182072 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.182195 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.182397 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.182621 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.182754 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.182895 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.183113 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.183238 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.183433 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.183566 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.183746 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.183881 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.184054 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.184189 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.184363 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.184503 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.184671 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.184805 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.184983 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.185111 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.185298 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.185442 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.185588 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.185709 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.185903 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.186026 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.186213 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.186337 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.186522 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.186645 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.186838 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.186996 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.187173 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.187312 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.187485 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.187627 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.187797 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.187921 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.188110 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.188255 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.188429 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.188553 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.188749 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.188871 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.189056 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.189256 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.189378 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.189508 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.189671 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.189794 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.189987 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.190123 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.190302 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.190428 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.190619 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.190757 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.190965 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.191109 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.191285 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.191408 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.191595 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.191722 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.191900 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.192023 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.192147 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 15:47:46.192271 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.192543 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.192866 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.193185 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.193520 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.193839 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.194156 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.194471 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.194789 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.195131 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.195452 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.195767 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.196083 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.196403 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.196724 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.197855 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.198202 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.198518 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.198858 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.199218 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.199573 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.199895 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.200246 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.200580 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.200902 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.201221 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.201533 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:47:46.201781 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 15:47:46.346686 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO dbcounter [None req-c94f56c6-a335-4812-82cc-646490a2566a None None] Registered counter for database nova_api Aug 26 15:47:46.359534 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO dbcounter [None req-798c7c7a-f104-4b1c-85ab-4ff860f3c889 None None] Registered counter for database nova_api Aug 26 15:47:46.369773 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_db.sqlalchemy.engines [None req-c94f56c6-a335-4812-82cc-646490a2566a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:47:46.376734 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG dbcounter [-] [112865] Writer thread running {{(pid=112865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:47:46.381105 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG oslo_db.sqlalchemy.engines [None req-798c7c7a-f104-4b1c-85ab-4ff860f3c889 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:47:46.388258 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG dbcounter [-] [112864] Writer thread running {{(pid=112864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:47:46.434635 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.context [None req-c94f56c6-a335-4812-82cc-646490a2566a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0b049a6f-4aea-43fa-a984-ec2d2c95e2da(cell1) {{(pid=112865) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 15:47:46.438442 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-c94f56c6-a335-4812-82cc-646490a2566a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:47:46.438909 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-c94f56c6-a335-4812-82cc-646490a2566a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:47:46.440584 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-c94f56c6-a335-4812-82cc-646490a2566a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:47:46.441311 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-c94f56c6-a335-4812-82cc-646490a2566a None None] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:47:46.441756 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-c94f56c6-a335-4812-82cc-646490a2566a None None] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:47:46.443750 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-c94f56c6-a335-4812-82cc-646490a2566a None None] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:47:46.444745 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.context [None req-798c7c7a-f104-4b1c-85ab-4ff860f3c889 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0b049a6f-4aea-43fa-a984-ec2d2c95e2da(cell1) {{(pid=112864) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 15:47:46.445734 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO dbcounter [None req-c94f56c6-a335-4812-82cc-646490a2566a None None] Registered counter for database nova_cell0 Aug 26 15:47:46.448922 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG oslo_concurrency.lockutils [None req-798c7c7a-f104-4b1c-85ab-4ff860f3c889 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:47:46.449399 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG oslo_concurrency.lockutils [None req-798c7c7a-f104-4b1c-85ab-4ff860f3c889 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:47:46.451010 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG oslo_concurrency.lockutils [None req-798c7c7a-f104-4b1c-85ab-4ff860f3c889 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:47:46.451351 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO dbcounter [None req-c94f56c6-a335-4812-82cc-646490a2566a None None] Registered counter for database nova_cell1 Aug 26 15:47:46.451770 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG oslo_concurrency.lockutils [None req-798c7c7a-f104-4b1c-85ab-4ff860f3c889 None None] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:47:46.452222 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG oslo_concurrency.lockutils [None req-798c7c7a-f104-4b1c-85ab-4ff860f3c889 None None] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:47:46.454207 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG oslo_concurrency.lockutils [None req-798c7c7a-f104-4b1c-85ab-4ff860f3c889 None None] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:47:46.456246 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO dbcounter [None req-798c7c7a-f104-4b1c-85ab-4ff860f3c889 None None] Registered counter for database nova_cell0 Aug 26 15:47:46.458774 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_db.sqlalchemy.engines [None req-c94f56c6-a335-4812-82cc-646490a2566a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:47:46.461051 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_db.sqlalchemy.engines [None req-c94f56c6-a335-4812-82cc-646490a2566a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:47:46.462104 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO dbcounter [None req-798c7c7a-f104-4b1c-85ab-4ff860f3c889 None None] Registered counter for database nova_cell1 Aug 26 15:47:46.466149 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG dbcounter [-] [112865] Writer thread running {{(pid=112865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:47:46.469052 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG dbcounter [-] [112865] Writer thread running {{(pid=112865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:47:46.469731 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG oslo_db.sqlalchemy.engines [None req-798c7c7a-f104-4b1c-85ab-4ff860f3c889 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:47:46.472091 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG oslo_db.sqlalchemy.engines [None req-798c7c7a-f104-4b1c-85ab-4ff860f3c889 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:47:46.476620 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG dbcounter [-] [112864] Writer thread running {{(pid=112864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:47:46.612758 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO dbcounter [None req-c94f56c6-a335-4812-82cc-646490a2566a None None] Registered counter for database nova_cell0 Aug 26 15:47:46.621379 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG dbcounter [-] [112864] Writer thread running {{(pid=112864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:47:46.622213 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_db.sqlalchemy.engines [None req-c94f56c6-a335-4812-82cc-646490a2566a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:47:46.626678 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG dbcounter [-] [112865] Writer thread running {{(pid=112865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:47:46.629882 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO dbcounter [None req-798c7c7a-f104-4b1c-85ab-4ff860f3c889 None None] Registered counter for database nova_cell0 Aug 26 15:47:46.639706 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG oslo_db.sqlalchemy.engines [None req-798c7c7a-f104-4b1c-85ab-4ff860f3c889 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:47:46.644129 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG dbcounter [-] [112864] Writer thread running {{(pid=112864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:47:47.060194 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: WARNING keystonemiddleware.auth_token [None req-c94f56c6-a335-4812-82cc-646490a2566a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 15:47:47.067806 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: WARNING keystonemiddleware.auth_token [None req-c94f56c6-a335-4812-82cc-646490a2566a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 15:47:47.187984 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: WARNING keystonemiddleware.auth_token [None req-798c7c7a-f104-4b1c-85ab-4ff860f3c889 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 15:47:47.195346 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: WARNING keystonemiddleware.auth_token [None req-798c7c7a-f104-4b1c-85ab-4ff860f3c889 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 15:47:47.414166 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: WARNING keystonemiddleware.auth_token [None req-c94f56c6-a335-4812-82cc-646490a2566a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 15:47:47.421004 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: WARNING keystonemiddleware.auth_token [None req-c94f56c6-a335-4812-82cc-646490a2566a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 15:47:47.426481 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5573412b89c0 pid: 112865 (default app) Aug 26 15:47:47.428811 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-c94f56c6-a335-4812-82cc-646490a2566a None None] Calling method '>' {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:47:47.430069 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-c94f56c6-a335-4812-82cc-646490a2566a None None] 10.222.0.94 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001935 Aug 26 15:47:47.430501 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 1/1] 10.222.0.94 () {50 vars in 788 bytes} [Fri Aug 26 15:47:47 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:47:47.539810 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: WARNING keystonemiddleware.auth_token [None req-798c7c7a-f104-4b1c-85ab-4ff860f3c889 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 15:47:47.546559 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: WARNING keystonemiddleware.auth_token [None req-798c7c7a-f104-4b1c-85ab-4ff860f3c889 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 15:47:47.551812 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5573412b89c0 pid: 112864 (default app) Aug 26 15:49:11.798640 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-c94f56c6-a335-4812-82cc-646490a2566a None None] Calling method '>' {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:49:11.799714 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-c94f56c6-a335-4812-82cc-646490a2566a None None] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 26 15:49:11.800111 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 2/2] 10.222.0.94 () {54 vars in 931 bytes} [Fri Aug 26 15:49:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:49:11.812480 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG dbcounter [-] [112864] Writing DB stats nova_api:SELECT=3 {{(pid=112864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:11.813414 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG dbcounter [-] [112864] Writing DB stats nova_cell1:SELECT=3 {{(pid=112864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:11.814220 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG dbcounter [-] [112864] Writing DB stats nova_cell0:SELECT=3 {{(pid=112864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:11.815246 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG dbcounter [-] [112864] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:12.946114 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-466dfb74-d152-49c8-9746-3ca8c1576144 admin admin] Calling method '>' {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:49:12.982232 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-466dfb74-d152-49c8-9746-3ca8c1576144 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.174777 Aug 26 15:49:12.982984 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 1/3] 10.222.0.94 () {60 vars in 1292 bytes} [Fri Aug 26 15:49:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:49:15.560918 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-c94f56c6-a335-4812-82cc-646490a2566a None None] Calling method '>' {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:49:15.561945 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-c94f56c6-a335-4812-82cc-646490a2566a None None] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001380 Aug 26 15:49:15.562298 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 3/4] 10.222.0.94 () {54 vars in 931 bytes} [Fri Aug 26 15:49:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:49:16.056453 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-cd2fa82d-7981-4cbc-9844-d4474dfd3d3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "swap": 0, "id": "c1", "name": "cirros256"}} {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:49:16.187346 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-cd2fa82d-7981-4cbc-9844-d4474dfd3d3f admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.617151 Aug 26 15:49:16.188114 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 2/5] 10.222.0.94 () {64 vars in 1283 bytes} [Fri Aug 26 15:49:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:49:16.440703 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-d81e0741-839e-4a8a-a16a-cd7bb20910c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:49:16.448385 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG dbcounter [-] [112865] Writing DB stats nova_api:SELECT=3 {{(pid=112865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:16.449212 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG dbcounter [-] [112865] Writing DB stats nova_cell1:SELECT=3 {{(pid=112865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:16.450120 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG dbcounter [-] [112865] Writing DB stats nova_cell0:SELECT=3 {{(pid=112865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:16.450867 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG dbcounter [-] [112865] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:16.610468 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-d81e0741-839e-4a8a-a16a-cd7bb20910c1 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.412156 Aug 26 15:49:16.611415 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 4/6] 10.222.0.94 () {64 vars in 1336 bytes} [Fri Aug 26 15:49:16 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:49:19.069739 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-cd2fa82d-7981-4cbc-9844-d4474dfd3d3f admin admin] Calling method '>' {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:49:19.070752 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-cd2fa82d-7981-4cbc-9844-d4474dfd3d3f admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 26 15:49:19.071501 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 3/7] 10.222.0.94 () {54 vars in 931 bytes} [Fri Aug 26 15:49:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:49:19.885491 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-32239c22-f32b-4268-841a-f332c99b0db7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "name": "ds512M", "vcpus": 1, "os-flavor-access:is_public": true, "disk": 5}} {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:49:20.035594 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-32239c22-f32b-4268-841a-f332c99b0db7 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.957868 Aug 26 15:49:20.043756 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 5/8] 10.222.0.94 () {64 vars in 1283 bytes} [Fri Aug 26 15:49:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:49:20.049593 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-4498a6e3-15d0-4f10-bc7a-d1bbc3a5ea09 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:49:20.171038 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-4498a6e3-15d0-4f10-bc7a-d1bbc3a5ea09 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.124923 Aug 26 15:49:20.172157 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 4/9] 10.222.0.94 () {64 vars in 1336 bytes} [Fri Aug 26 15:49:20 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:49:22.606382 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-32239c22-f32b-4268-841a-f332c99b0db7 admin admin] Calling method '>' {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:49:22.607448 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-32239c22-f32b-4268-841a-f332c99b0db7 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 26 15:49:22.607852 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 6/10] 10.222.0.94 () {54 vars in 931 bytes} [Fri Aug 26 15:49:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:49:23.033263 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-d3f5cb15-1267-43f6-8d79-18ac08b1ebb8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 1024, "name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "swap": 0, "id": "d2"}} {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:49:23.091196 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-d3f5cb15-1267-43f6-8d79-18ac08b1ebb8 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.477100 Aug 26 15:49:23.091860 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 5/11] 10.222.0.94 () {64 vars in 1283 bytes} [Fri Aug 26 15:49:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 15:49:23.104921 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-42ddc8a3-2740-4fee-b4c1-eaa14c2ceb63 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:49:23.197674 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-42ddc8a3-2740-4fee-b4c1-eaa14c2ceb63 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096478 Aug 26 15:49:23.198251 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 7/12] 10.222.0.94 () {64 vars in 1336 bytes} [Fri Aug 26 15:49:23 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:49:25.629034 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-d3f5cb15-1267-43f6-8d79-18ac08b1ebb8 admin admin] Calling method '>' {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:49:25.630640 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-d3f5cb15-1267-43f6-8d79-18ac08b1ebb8 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002036 Aug 26 15:49:25.632010 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 6/13] 10.222.0.94 () {54 vars in 931 bytes} [Fri Aug 26 15:49:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:49:26.064314 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-4fe72ace-5853-44d4-ba4b-8ff4eddc04f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 2, "id": "d3", "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:49:26.147641 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-4fe72ace-5853-44d4-ba4b-8ff4eddc04f1 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.509155 Aug 26 15:49:26.148538 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 8/14] 10.222.0.94 () {64 vars in 1283 bytes} [Fri Aug 26 15:49:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 15:49:26.160434 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-bdc414d4-c4ca-45b6-a777-fdbb8201ed78 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:49:26.254362 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-bdc414d4-c4ca-45b6-a777-fdbb8201ed78 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097558 Aug 26 15:49:26.255145 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 7/15] 10.222.0.94 () {64 vars in 1336 bytes} [Fri Aug 26 15:49:26 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:49:28.673630 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-4fe72ace-5853-44d4-ba4b-8ff4eddc04f1 admin admin] Calling method '>' {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:49:28.674652 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-4fe72ace-5853-44d4-ba4b-8ff4eddc04f1 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 26 15:49:28.675268 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 9/16] 10.222.0.94 () {54 vars in 931 bytes} [Fri Aug 26 15:49:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:49:29.133129 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-6ff7aba1-e7d5-4199-bf66-eb92424d4641 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "name": "ds4G", "rxtx_factor": 1.0, "ram": 4096, "disk": 20, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:49:29.228346 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-6ff7aba1-e7d5-4199-bf66-eb92424d4641 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.546698 Aug 26 15:49:29.229078 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 8/17] 10.222.0.94 () {64 vars in 1283 bytes} [Fri Aug 26 15:49:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:49:29.242069 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-cb6bb172-2e3b-4ad7-9554-d5511583679a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:49:29.324516 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-cb6bb172-2e3b-4ad7-9554-d5511583679a admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086954 Aug 26 15:49:29.325249 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 10/18] 10.222.0.94 () {64 vars in 1336 bytes} [Fri Aug 26 15:49:29 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:49:31.795661 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-6ff7aba1-e7d5-4199-bf66-eb92424d4641 admin admin] Calling method '>' {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:49:31.796691 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-6ff7aba1-e7d5-4199-bf66-eb92424d4641 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 26 15:49:31.797163 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 9/19] 10.222.0.94 () {54 vars in 931 bytes} [Fri Aug 26 15:49:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:49:32.248275 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-d4af1d65-eec6-4ebf-b809-85db4095a79b admin admin] Calling method '>' {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:49:32.282196 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-d4af1d65-eec6-4ebf-b809-85db4095a79b admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.477704 Aug 26 15:49:32.282885 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 11/20] 10.222.0.94 () {60 vars in 1292 bytes} [Fri Aug 26 15:49:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:49:34.927361 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-6ff7aba1-e7d5-4199-bf66-eb92424d4641 admin admin] Calling method '>' {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:49:34.928478 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-6ff7aba1-e7d5-4199-bf66-eb92424d4641 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Aug 26 15:49:34.928885 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 10/21] 10.222.0.94 () {54 vars in 931 bytes} [Fri Aug 26 15:49:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:49:35.398985 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-55e3b51e-4389-4a8c-a2c3-78aa54670da8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "swap": 0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1}} {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:49:35.497321 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-55e3b51e-4389-4a8c-a2c3-78aa54670da8 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.561608 Aug 26 15:49:35.498113 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 12/22] 10.222.0.94 () {64 vars in 1283 bytes} [Fri Aug 26 15:49:34 2022] POST /compute/v2.1/flavors => generated 402 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:49:35.513524 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-6b18e1ca-ea98-4430-8212-0b1327e0c863 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:49:35.619920 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-6b18e1ca-ea98-4430-8212-0b1327e0c863 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110816 Aug 26 15:49:35.620514 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 11/23] 10.222.0.94 () {64 vars in 1333 bytes} [Fri Aug 26 15:49:35 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:49:38.340960 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-55e3b51e-4389-4a8c-a2c3-78aa54670da8 admin admin] Calling method '>' {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:49:38.364367 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-55e3b51e-4389-4a8c-a2c3-78aa54670da8 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001795 Aug 26 15:49:38.364367 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 13/24] 10.222.0.94 () {54 vars in 931 bytes} [Fri Aug 26 15:49:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:49:38.854253 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-8c64bd52-56d2-42da-be54-e9bb4789091d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "m1.small", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "2", "swap": 0, "disk": 20, "vcpus": 1}} {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:49:38.913039 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-8c64bd52-56d2-42da-be54-e9bb4789091d admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.563236 Aug 26 15:49:38.913551 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 12/25] 10.222.0.94 () {64 vars in 1283 bytes} [Fri Aug 26 15:49:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 15:49:38.926112 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-15515f35-4758-47c1-a8d0-9b0755cea025 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:49:39.009887 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-15515f35-4758-47c1-a8d0-9b0755cea025 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087787 Aug 26 15:49:39.010594 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 14/26] 10.222.0.94 () {64 vars in 1333 bytes} [Fri Aug 26 15:49:38 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:49:41.489947 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-8c64bd52-56d2-42da-be54-e9bb4789091d admin admin] Calling method '>' {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:49:41.491187 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-8c64bd52-56d2-42da-be54-e9bb4789091d admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001628 Aug 26 15:49:41.491600 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 13/27] 10.222.0.94 () {54 vars in 931 bytes} [Fri Aug 26 15:49:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:49:41.874055 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-075501bd-9c3f-4b39-9d8f-22aa33c924b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "m1.medium", "disk": 40, "ram": 4096, "id": "3"}} {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:49:41.976727 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-075501bd-9c3f-4b39-9d8f-22aa33c924b9 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.478765 Aug 26 15:49:41.977276 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 15/28] 10.222.0.94 () {64 vars in 1283 bytes} [Fri Aug 26 15:49:41 2022] POST /compute/v2.1/flavors => generated 406 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:49:41.989609 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-44e1a0d1-4b76-46d1-859c-9d5cb915b571 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:49:41.995341 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG dbcounter [-] [112864] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=112864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:42.135130 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-44e1a0d1-4b76-46d1-859c-9d5cb915b571 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.149171 Aug 26 15:49:42.136270 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 14/29] 10.222.0.94 () {64 vars in 1333 bytes} [Fri Aug 26 15:49:41 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:49:44.775891 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-075501bd-9c3f-4b39-9d8f-22aa33c924b9 admin admin] Calling method '>' {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:49:44.777699 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-075501bd-9c3f-4b39-9d8f-22aa33c924b9 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002233 Aug 26 15:49:44.778202 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 16/30] 10.222.0.94 () {54 vars in 931 bytes} [Fri Aug 26 15:49:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:49:45.241451 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-f8144c0b-2e6b-46a4-bbdc-f187fca9d55d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "4", "vcpus": 4, "rxtx_factor": 1.0, "name": "m1.large", "os-flavor-access:is_public": true}} {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:49:45.337813 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-f8144c0b-2e6b-46a4-bbdc-f187fca9d55d admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.553129 Aug 26 15:49:45.338374 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 15/31] 10.222.0.94 () {64 vars in 1283 bytes} [Fri Aug 26 15:49:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 15:49:45.354308 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-e78da3c6-c67d-4cd7-b6d3-093dfdad8434 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:49:45.432014 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-e78da3c6-c67d-4cd7-b6d3-093dfdad8434 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085116 Aug 26 15:49:45.432794 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 17/32] 10.222.0.94 () {64 vars in 1333 bytes} [Fri Aug 26 15:49:45 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:49:47.869464 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-f8144c0b-2e6b-46a4-bbdc-f187fca9d55d admin admin] Calling method '>' {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:49:47.870499 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-f8144c0b-2e6b-46a4-bbdc-f187fca9d55d admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 26 15:49:47.871077 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 16/33] 10.222.0.94 () {54 vars in 931 bytes} [Fri Aug 26 15:49:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:49:48.338254 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-2e2d7555-e03b-4892-8eb3-8e3b32dc407b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "vcpus": 8, "swap": 0, "os-flavor-access:is_public": true, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 16384, "id": "5"}} {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:49:48.421637 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-2e2d7555-e03b-4892-8eb3-8e3b32dc407b admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.544463 Aug 26 15:49:48.422501 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 18/34] 10.222.0.94 () {64 vars in 1283 bytes} [Fri Aug 26 15:49:47 2022] POST /compute/v2.1/flavors => generated 408 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:49:48.435577 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-7836d7da-40d0-4ce9-a3f7-563bed8cd664 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:49:48.522187 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-7836d7da-40d0-4ce9-a3f7-563bed8cd664 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090262 Aug 26 15:49:48.522760 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 17/35] 10.222.0.94 () {64 vars in 1333 bytes} [Fri Aug 26 15:49:48 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:50:08.898566 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-2e2d7555-e03b-4892-8eb3-8e3b32dc407b admin admin] Calling method '>' {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:08.899626 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-2e2d7555-e03b-4892-8eb3-8e3b32dc407b admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Aug 26 15:50:08.900032 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 19/36] 10.222.0.94 () {54 vars in 931 bytes} [Fri Aug 26 15:50:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:08.910506 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG dbcounter [-] [112864] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=112864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:09.301131 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-ac5c8d66-519e-4386-a4e2-4d9a3393a0a7 admin admin] Calling method '>' {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:09.319745 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-ac5c8d66-519e-4386-a4e2-4d9a3393a0a7 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.413611 Aug 26 15:50:09.320440 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 18/37] 10.222.0.94 () {60 vars in 1292 bytes} [Fri Aug 26 15:50:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:50:10.413432 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-2e2d7555-e03b-4892-8eb3-8e3b32dc407b admin admin] Calling method '>' {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:10.414523 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-2e2d7555-e03b-4892-8eb3-8e3b32dc407b admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 26 15:50:10.414956 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 20/38] 10.222.0.94 () {56 vars in 1074 bytes} [Fri Aug 26 15:50:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:10.946132 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-4cbf3e88-6765-42d5-9a20-640d35febbe6 admin admin] Calling method '>' {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:10.952178 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.wsgi [None req-4cbf3e88-6765-42d5-9a20-640d35febbe6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 26 15:50:10.955517 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-4cbf3e88-6765-42d5-9a20-640d35febbe6 admin admin] Request method failure captured: Aug 26 15:50:10.955517 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 26 15:50:10.955517 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: Accept: application/json Aug 26 15:50:10.955517 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: Accept-Encoding: gzip, deflate Aug 26 15:50:10.955517 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: Connection: keep-alive Aug 26 15:50:10.955517 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: Content-Length: 0 Aug 26 15:50:10.955517 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: Host: 10.222.0.94 Aug 26 15:50:10.955517 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: Openstack-Api-Version: compute 2.90 Aug 26 15:50:10.955517 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: Openstack-System-Scope: None Aug 26 15:50:10.955517 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: User-Agent: python-novaclient Aug 26 15:50:10.955517 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Auth-Token: gAAAAABjCOuyuAXnYV-XULtMN0G44o8pC87bJ1dKC6H7hqUigzB34fyl1q6PS5M2Kuh6bVYj80mCRvCHPkOS0PpnCnIRTeUs8m9by0YkKNA3EMpVmheEjjv4uJxS13pPPmA5pSeP2dT9ElwKD3zndFAMRXdF8dZpgqrtEQSU5hhNJF050NNgtEg Aug 26 15:50:10.955517 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Domain-Id: None Aug 26 15:50:10.955517 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Domain-Name: None Aug 26 15:50:10.955517 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Identity-Status: Confirmed Aug 26 15:50:10.955517 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Is-Admin-Project: True Aug 26 15:50:10.955517 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 15:50:10.955517 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Project-Domain-Id: default Aug 26 15:50:10.955517 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Project-Domain-Name: Default Aug 26 15:50:10.955517 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Project-Id: 27572d94c00243fdbbfd37ae021fbe77 Aug 26 15:50:10.955517 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Project-Name: admin Aug 26 15:50:10.955517 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Role: member,reader,admin Aug 26 15:50:10.955517 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Roles: member,reader,admin Aug 26 15:50:10.957583 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/27572d94c00243fdbbfd37ae021fbe77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/27572d94c00243fdbbfd37ae021fbe77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/27572d94c00243fdbbfd37ae021fbe77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_27572d94c00243fdbbfd37ae021fbe77", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 15:50:10.957583 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Tenant: admin Aug 26 15:50:10.957583 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Tenant-Id: 27572d94c00243fdbbfd37ae021fbe77 Aug 26 15:50:10.957583 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Tenant-Name: admin Aug 26 15:50:10.957583 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-User: admin Aug 26 15:50:10.957583 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-User-Domain-Id: default Aug 26 15:50:10.957583 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-User-Domain-Name: Default Aug 26 15:50:10.957583 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-User-Id: 5f7a209666c0478690d711f7d361c03b Aug 26 15:50:10.957583 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-User-Name: admin Aug 26 15:50:10.957583 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: method: > Aug 26 15:50:10.957583 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: exception: Flavor 42 could not be found. Aug 26 15:50:10.957583 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: action_args: {'id': '42'} Aug 26 15:50:10.957583 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:50:10.957583 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:10.958636 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 15:50:10.958636 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 15:50:10.958636 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 15:50:10.958636 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 15:50:10.958636 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 15:50:10.958636 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 15:50:10.958636 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 15:50:10.958636 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 15:50:10.958636 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 15:50:10.958636 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:50:10.958636 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 15:50:10.958636 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 15:50:10.958636 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 26 15:50:10.958636 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi Aug 26 15:50:10.958636 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:10.958636 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi Aug 26 15:50:10.958636 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:10.958636 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:10.958636 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:10.965569 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:50:10.965569 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:50:10.965569 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:50:10.965569 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:50:10.965569 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 15:50:10.965569 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:50:10.965569 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 26 15:50:10.965569 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi Aug 26 15:50:10.965569 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:10.965569 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi Aug 26 15:50:10.965569 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:10.965569 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:10.965569 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:10.965569 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:50:10.965569 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:50:10.965569 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 26 15:50:10.965569 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi Aug 26 15:50:10.965569 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-4cbf3e88-6765-42d5-9a20-640d35febbe6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:50:10.967192 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-4cbf3e88-6765-42d5-9a20-640d35febbe6 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.402328 Aug 26 15:50:10.967192 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 19/39] 10.222.0.94 () {60 vars in 1190 bytes} [Fri Aug 26 15:50:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 15:50:10.967357 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-121afd2d-e1f7-4e43-9633-6f71cbc88e1a admin admin] Calling method '>' {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:10.971367 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG dbcounter [-] [112865] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=112865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:10.991349 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-121afd2d-e1f7-4e43-9633-6f71cbc88e1a admin admin] 10.222.0.94 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028002 Aug 26 15:50:10.991879 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 21/40] 10.222.0.94 () {60 vars in 1210 bytes} [Fri Aug 26 15:50:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:50:11.001826 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-258882a7-61cc-4952-9e5a-f2228830d7dd admin admin] Calling method '>' {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:11.026231 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-258882a7-61cc-4952-9e5a-f2228830d7dd admin admin] 10.222.0.94 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028034 Aug 26 15:50:11.026777 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 20/41] 10.222.0.94 () {60 vars in 1210 bytes} [Fri Aug 26 15:50:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:50:11.036480 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-a6796743-de25-4c7c-9031-147de195fed4 admin admin] Calling method '>' {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:11.042537 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.wsgi [None req-a6796743-de25-4c7c-9031-147de195fed4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 26 15:50:11.045865 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-a6796743-de25-4c7c-9031-147de195fed4 admin admin] Request method failure captured: Aug 26 15:50:11.045865 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 26 15:50:11.045865 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: Accept: application/json Aug 26 15:50:11.045865 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: Accept-Encoding: gzip, deflate Aug 26 15:50:11.045865 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: Connection: keep-alive Aug 26 15:50:11.045865 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: Content-Length: 0 Aug 26 15:50:11.045865 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: Host: 10.222.0.94 Aug 26 15:50:11.045865 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: Openstack-Api-Version: compute 2.90 Aug 26 15:50:11.045865 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: Openstack-System-Scope: None Aug 26 15:50:11.045865 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: User-Agent: python-novaclient Aug 26 15:50:11.045865 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Auth-Token: gAAAAABjCOuyuAXnYV-XULtMN0G44o8pC87bJ1dKC6H7hqUigzB34fyl1q6PS5M2Kuh6bVYj80mCRvCHPkOS0PpnCnIRTeUs8m9by0YkKNA3EMpVmheEjjv4uJxS13pPPmA5pSeP2dT9ElwKD3zndFAMRXdF8dZpgqrtEQSU5hhNJF050NNgtEg Aug 26 15:50:11.045865 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Domain-Id: None Aug 26 15:50:11.045865 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Domain-Name: None Aug 26 15:50:11.045865 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Identity-Status: Confirmed Aug 26 15:50:11.045865 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Is-Admin-Project: True Aug 26 15:50:11.045865 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 15:50:11.045865 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Project-Domain-Id: default Aug 26 15:50:11.045865 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Project-Domain-Name: Default Aug 26 15:50:11.045865 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Project-Id: 27572d94c00243fdbbfd37ae021fbe77 Aug 26 15:50:11.045865 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Project-Name: admin Aug 26 15:50:11.045865 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Role: member,reader,admin Aug 26 15:50:11.045865 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Roles: member,reader,admin Aug 26 15:50:11.053279 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/27572d94c00243fdbbfd37ae021fbe77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/27572d94c00243fdbbfd37ae021fbe77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/27572d94c00243fdbbfd37ae021fbe77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_27572d94c00243fdbbfd37ae021fbe77", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 15:50:11.053279 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Tenant: admin Aug 26 15:50:11.053279 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Tenant-Id: 27572d94c00243fdbbfd37ae021fbe77 Aug 26 15:50:11.053279 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Tenant-Name: admin Aug 26 15:50:11.053279 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-User: admin Aug 26 15:50:11.053279 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-User-Domain-Id: default Aug 26 15:50:11.053279 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-User-Domain-Name: Default Aug 26 15:50:11.053279 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-User-Id: 5f7a209666c0478690d711f7d361c03b Aug 26 15:50:11.053279 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-User-Name: admin Aug 26 15:50:11.053279 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: method: > Aug 26 15:50:11.053279 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: exception: Flavor 42 could not be found. Aug 26 15:50:11.053279 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: action_args: {'id': '42'} Aug 26 15:50:11.053279 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:50:11.053279 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:11.054374 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 15:50:11.054374 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 15:50:11.054374 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 15:50:11.054374 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 15:50:11.054374 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 15:50:11.054374 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 15:50:11.054374 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 15:50:11.054374 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 15:50:11.054374 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 15:50:11.054374 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:50:11.054374 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 15:50:11.054374 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 15:50:11.054374 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 26 15:50:11.054374 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi Aug 26 15:50:11.054374 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:11.054374 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi Aug 26 15:50:11.054374 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:11.054374 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:11.054374 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:11.055775 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:50:11.055775 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:50:11.055775 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:50:11.055775 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:50:11.055775 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 15:50:11.055775 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:50:11.055775 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 26 15:50:11.055775 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi Aug 26 15:50:11.055775 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:11.055775 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi Aug 26 15:50:11.055775 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:11.055775 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:11.055775 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:11.055775 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:50:11.055775 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:50:11.055775 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 26 15:50:11.055775 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi Aug 26 15:50:11.055775 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-a6796743-de25-4c7c-9031-147de195fed4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:50:11.057010 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-a6796743-de25-4c7c-9031-147de195fed4 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014474 Aug 26 15:50:11.057010 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 22/42] 10.222.0.94 () {60 vars in 1190 bytes} [Fri Aug 26 15:50:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 15:50:12.023895 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-258882a7-61cc-4952-9e5a-f2228830d7dd admin admin] Calling method '>' {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:12.024905 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-258882a7-61cc-4952-9e5a-f2228830d7dd admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 26 15:50:12.025292 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 21/43] 10.222.0.94 () {56 vars in 1074 bytes} [Fri Aug 26 15:50:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:12.554091 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-45120952-9b5d-4c35-8161-3fe90013661e admin admin] Calling method '>' {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:12.559425 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.wsgi [None req-45120952-9b5d-4c35-8161-3fe90013661e admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 26 15:50:12.560924 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-45120952-9b5d-4c35-8161-3fe90013661e admin admin] Request method failure captured: Aug 26 15:50:12.560924 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 26 15:50:12.560924 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: Accept: application/json Aug 26 15:50:12.560924 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: Accept-Encoding: gzip, deflate Aug 26 15:50:12.560924 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: Connection: keep-alive Aug 26 15:50:12.560924 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: Content-Length: 0 Aug 26 15:50:12.560924 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: Host: 10.222.0.94 Aug 26 15:50:12.560924 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: Openstack-Api-Version: compute 2.90 Aug 26 15:50:12.560924 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: Openstack-System-Scope: None Aug 26 15:50:12.560924 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: User-Agent: python-novaclient Aug 26 15:50:12.560924 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Auth-Token: gAAAAABjCOuzpLfJvqwoQVOumX4CEggADp3EGzaQl0n0bjsPLEzH6hLLDSAGT_vrzR_SyethKVJU7C0gNqdZY7h26rGNK6OCo_pJeyldYrspYhlKzcwmqnSEXcklW51W0a4DGEEdPW_7Y4duoLGLvavn9aMUwK-goNoMRQwpuCq4cyoKSb5Fyq0 Aug 26 15:50:12.560924 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Domain-Id: None Aug 26 15:50:12.560924 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Domain-Name: None Aug 26 15:50:12.560924 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Identity-Status: Confirmed Aug 26 15:50:12.560924 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Is-Admin-Project: True Aug 26 15:50:12.560924 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 15:50:12.560924 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Project-Domain-Id: default Aug 26 15:50:12.560924 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Project-Domain-Name: Default Aug 26 15:50:12.560924 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Project-Id: 27572d94c00243fdbbfd37ae021fbe77 Aug 26 15:50:12.560924 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Project-Name: admin Aug 26 15:50:12.560924 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Role: member,reader,admin Aug 26 15:50:12.560924 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Roles: member,reader,admin Aug 26 15:50:12.562485 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/27572d94c00243fdbbfd37ae021fbe77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/27572d94c00243fdbbfd37ae021fbe77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/27572d94c00243fdbbfd37ae021fbe77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_27572d94c00243fdbbfd37ae021fbe77", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 15:50:12.562485 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Tenant: admin Aug 26 15:50:12.562485 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Tenant-Id: 27572d94c00243fdbbfd37ae021fbe77 Aug 26 15:50:12.562485 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Tenant-Name: admin Aug 26 15:50:12.562485 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-User: admin Aug 26 15:50:12.562485 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-User-Domain-Id: default Aug 26 15:50:12.562485 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-User-Domain-Name: Default Aug 26 15:50:12.562485 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-User-Id: 5f7a209666c0478690d711f7d361c03b Aug 26 15:50:12.562485 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-User-Name: admin Aug 26 15:50:12.562485 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: method: > Aug 26 15:50:12.562485 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: exception: Flavor 84 could not be found. Aug 26 15:50:12.562485 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: action_args: {'id': '84'} Aug 26 15:50:12.562485 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:50:12.562485 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:12.563404 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 15:50:12.563404 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 15:50:12.563404 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 15:50:12.563404 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 15:50:12.563404 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 15:50:12.563404 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 15:50:12.563404 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 15:50:12.563404 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 15:50:12.563404 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 15:50:12.563404 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:50:12.563404 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 15:50:12.563404 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 15:50:12.563404 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 26 15:50:12.563404 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi Aug 26 15:50:12.563404 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:12.563404 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi Aug 26 15:50:12.563404 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:12.563404 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:12.563404 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:12.564473 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:50:12.564473 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:50:12.564473 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:50:12.564473 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:50:12.564473 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 15:50:12.564473 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:50:12.564473 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 26 15:50:12.564473 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi Aug 26 15:50:12.564473 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:12.564473 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi Aug 26 15:50:12.564473 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:12.564473 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:12.564473 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:12.564473 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:50:12.564473 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:50:12.564473 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 26 15:50:12.564473 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi Aug 26 15:50:12.564473 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-45120952-9b5d-4c35-8161-3fe90013661e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:50:12.565501 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-45120952-9b5d-4c35-8161-3fe90013661e admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.399128 Aug 26 15:50:12.565501 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 23/44] 10.222.0.94 () {60 vars in 1190 bytes} [Fri Aug 26 15:50:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 15:50:12.574342 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-274f6fc1-695f-44fb-b167-200f3582a052 admin admin] Calling method '>' {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:12.593575 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-274f6fc1-695f-44fb-b167-200f3582a052 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024274 Aug 26 15:50:12.594122 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 22/45] 10.222.0.94 () {60 vars in 1210 bytes} [Fri Aug 26 15:50:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:50:12.603814 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-19c1933d-649a-4906-88ef-2986ce4f6198 admin admin] Calling method '>' {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:12.621449 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-19c1933d-649a-4906-88ef-2986ce4f6198 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021147 Aug 26 15:50:12.621984 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 24/46] 10.222.0.94 () {60 vars in 1210 bytes} [Fri Aug 26 15:50:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:50:12.632026 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-41839284-f18e-42d5-82a2-d7f95a9b04af admin admin] Calling method '>' {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:12.637380 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.wsgi [None req-41839284-f18e-42d5-82a2-d7f95a9b04af admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 26 15:50:12.638849 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-41839284-f18e-42d5-82a2-d7f95a9b04af admin admin] Request method failure captured: Aug 26 15:50:12.638849 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 26 15:50:12.638849 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: Accept: application/json Aug 26 15:50:12.638849 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: Accept-Encoding: gzip, deflate Aug 26 15:50:12.638849 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: Connection: keep-alive Aug 26 15:50:12.638849 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: Content-Length: 0 Aug 26 15:50:12.638849 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: Host: 10.222.0.94 Aug 26 15:50:12.638849 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: Openstack-Api-Version: compute 2.90 Aug 26 15:50:12.638849 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: Openstack-System-Scope: None Aug 26 15:50:12.638849 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: User-Agent: python-novaclient Aug 26 15:50:12.638849 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Auth-Token: gAAAAABjCOuzpLfJvqwoQVOumX4CEggADp3EGzaQl0n0bjsPLEzH6hLLDSAGT_vrzR_SyethKVJU7C0gNqdZY7h26rGNK6OCo_pJeyldYrspYhlKzcwmqnSEXcklW51W0a4DGEEdPW_7Y4duoLGLvavn9aMUwK-goNoMRQwpuCq4cyoKSb5Fyq0 Aug 26 15:50:12.638849 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Domain-Id: None Aug 26 15:50:12.638849 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Domain-Name: None Aug 26 15:50:12.638849 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Identity-Status: Confirmed Aug 26 15:50:12.638849 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Is-Admin-Project: True Aug 26 15:50:12.638849 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 15:50:12.638849 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Project-Domain-Id: default Aug 26 15:50:12.638849 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Project-Domain-Name: Default Aug 26 15:50:12.638849 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Project-Id: 27572d94c00243fdbbfd37ae021fbe77 Aug 26 15:50:12.638849 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Project-Name: admin Aug 26 15:50:12.638849 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Role: member,reader,admin Aug 26 15:50:12.638849 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Roles: member,reader,admin Aug 26 15:50:12.640369 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/27572d94c00243fdbbfd37ae021fbe77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/27572d94c00243fdbbfd37ae021fbe77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/27572d94c00243fdbbfd37ae021fbe77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_27572d94c00243fdbbfd37ae021fbe77", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 15:50:12.640369 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Tenant: admin Aug 26 15:50:12.640369 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Tenant-Id: 27572d94c00243fdbbfd37ae021fbe77 Aug 26 15:50:12.640369 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Tenant-Name: admin Aug 26 15:50:12.640369 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-User: admin Aug 26 15:50:12.640369 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-User-Domain-Id: default Aug 26 15:50:12.640369 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-User-Domain-Name: Default Aug 26 15:50:12.640369 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-User-Id: 5f7a209666c0478690d711f7d361c03b Aug 26 15:50:12.640369 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-User-Name: admin Aug 26 15:50:12.640369 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: method: > Aug 26 15:50:12.640369 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: exception: Flavor 84 could not be found. Aug 26 15:50:12.640369 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: action_args: {'id': '84'} Aug 26 15:50:12.640369 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:50:12.640369 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:12.641411 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 15:50:12.641411 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 15:50:12.641411 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 15:50:12.641411 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 15:50:12.641411 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 15:50:12.641411 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 15:50:12.641411 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 15:50:12.641411 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 15:50:12.641411 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 15:50:12.641411 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:50:12.641411 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 15:50:12.641411 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 15:50:12.641411 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 26 15:50:12.641411 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi Aug 26 15:50:12.641411 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:12.641411 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi Aug 26 15:50:12.641411 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:12.641411 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:12.641411 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:12.642646 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:50:12.642646 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:50:12.642646 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:50:12.642646 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:50:12.642646 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 15:50:12.642646 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:50:12.642646 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 26 15:50:12.642646 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi Aug 26 15:50:12.642646 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:12.642646 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi Aug 26 15:50:12.642646 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:12.642646 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:12.642646 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:12.642646 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:50:12.642646 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:50:12.642646 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 26 15:50:12.642646 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi Aug 26 15:50:12.642646 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-41839284-f18e-42d5-82a2-d7f95a9b04af admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:50:12.643907 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-41839284-f18e-42d5-82a2-d7f95a9b04af admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012406 Aug 26 15:50:12.644234 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 23/47] 10.222.0.94 () {60 vars in 1190 bytes} [Fri Aug 26 15:50:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 15:50:13.640446 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-19c1933d-649a-4906-88ef-2986ce4f6198 admin admin] Calling method '>' {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:13.642811 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-19c1933d-649a-4906-88ef-2986ce4f6198 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002277 Aug 26 15:50:13.643234 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 25/48] 10.222.0.94 () {56 vars in 1074 bytes} [Fri Aug 26 15:50:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:14.186178 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-09420de5-adea-422d-a149-d8b96e858cfd admin admin] Calling method '>' {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:14.193664 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.wsgi [None req-09420de5-adea-422d-a149-d8b96e858cfd admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 26 15:50:14.195210 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-09420de5-adea-422d-a149-d8b96e858cfd admin admin] Request method failure captured: Aug 26 15:50:14.195210 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 26 15:50:14.195210 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: Accept: application/json Aug 26 15:50:14.195210 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: Accept-Encoding: gzip, deflate Aug 26 15:50:14.195210 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: Connection: keep-alive Aug 26 15:50:14.195210 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: Content-Length: 0 Aug 26 15:50:14.195210 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: Host: 10.222.0.94 Aug 26 15:50:14.195210 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: Openstack-Api-Version: compute 2.90 Aug 26 15:50:14.195210 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: Openstack-System-Scope: None Aug 26 15:50:14.195210 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: User-Agent: python-novaclient Aug 26 15:50:14.195210 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Auth-Token: gAAAAABjCOu1Wp6Tw-fuTFeHrFdZFNPgjD7ShsnlosKZLJdL3BeTDOnGFFHutKhz-lyAQ5MdGgJp_ryaV6XhI3h6K0bmpb68ixseXlCLyRzf1ztc87a84s0lZzRfDAtzuamuQNipU4Gzs4yX3z-8luIPwWYs4nEDmno6yvtqycXP9eEEiJRrE-c Aug 26 15:50:14.195210 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Domain-Id: None Aug 26 15:50:14.195210 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Domain-Name: None Aug 26 15:50:14.195210 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Identity-Status: Confirmed Aug 26 15:50:14.195210 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Is-Admin-Project: True Aug 26 15:50:14.195210 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 15:50:14.195210 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Project-Domain-Id: default Aug 26 15:50:14.195210 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Project-Domain-Name: Default Aug 26 15:50:14.195210 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Project-Id: 27572d94c00243fdbbfd37ae021fbe77 Aug 26 15:50:14.195210 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Project-Name: admin Aug 26 15:50:14.195210 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Role: member,reader,admin Aug 26 15:50:14.195210 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Roles: member,reader,admin Aug 26 15:50:14.196811 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/27572d94c00243fdbbfd37ae021fbe77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/27572d94c00243fdbbfd37ae021fbe77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/27572d94c00243fdbbfd37ae021fbe77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_27572d94c00243fdbbfd37ae021fbe77", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 15:50:14.196811 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Tenant: admin Aug 26 15:50:14.196811 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Tenant-Id: 27572d94c00243fdbbfd37ae021fbe77 Aug 26 15:50:14.196811 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-Tenant-Name: admin Aug 26 15:50:14.196811 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-User: admin Aug 26 15:50:14.196811 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-User-Domain-Id: default Aug 26 15:50:14.196811 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-User-Domain-Name: Default Aug 26 15:50:14.196811 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-User-Id: 5f7a209666c0478690d711f7d361c03b Aug 26 15:50:14.196811 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: X-User-Name: admin Aug 26 15:50:14.196811 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: method: > Aug 26 15:50:14.196811 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: exception: Flavor 451 could not be found. Aug 26 15:50:14.196811 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: action_args: {'id': '451'} Aug 26 15:50:14.196811 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:50:14.196811 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:14.197795 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 15:50:14.197795 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 15:50:14.197795 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 15:50:14.197795 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 15:50:14.197795 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 15:50:14.197795 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 15:50:14.197795 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 15:50:14.197795 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 15:50:14.197795 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 15:50:14.197795 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:50:14.197795 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 15:50:14.197795 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 15:50:14.197795 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 26 15:50:14.197795 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi Aug 26 15:50:14.197795 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:14.197795 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi Aug 26 15:50:14.197795 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:14.197795 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:14.197795 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:14.199106 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:50:14.199106 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:50:14.199106 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:50:14.199106 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:50:14.199106 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 15:50:14.199106 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:50:14.199106 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 26 15:50:14.199106 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi Aug 26 15:50:14.199106 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:14.199106 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi Aug 26 15:50:14.199106 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:14.199106 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:14.199106 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:14.199106 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:50:14.199106 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:50:14.199106 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 26 15:50:14.199106 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: ERROR nova.api.openstack.wsgi Aug 26 15:50:14.199106 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-09420de5-adea-422d-a149-d8b96e858cfd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:50:14.200531 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-09420de5-adea-422d-a149-d8b96e858cfd admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.414804 Aug 26 15:50:14.200531 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 24/49] 10.222.0.94 () {60 vars in 1193 bytes} [Fri Aug 26 15:50:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 15:50:14.206390 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-53fd50a3-31ac-45fb-b0ac-5d40473879a6 admin admin] Calling method '>' {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:14.221961 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-53fd50a3-31ac-45fb-b0ac-5d40473879a6 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019120 Aug 26 15:50:14.222498 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 26/50] 10.222.0.94 () {60 vars in 1210 bytes} [Fri Aug 26 15:50:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:50:14.232439 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-28d4c9a3-a554-40f4-b9a0-94465528c3b2 admin admin] Calling method '>' {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:14.249287 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-28d4c9a3-a554-40f4-b9a0-94465528c3b2 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020288 Aug 26 15:50:14.250038 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 25/51] 10.222.0.94 () {60 vars in 1210 bytes} [Fri Aug 26 15:50:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:50:14.260592 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-339ad379-abe4-49e7-95b0-cbe7000b0c10 admin admin] Calling method '>' {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:14.266855 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.wsgi [None req-339ad379-abe4-49e7-95b0-cbe7000b0c10 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 26 15:50:14.268645 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-339ad379-abe4-49e7-95b0-cbe7000b0c10 admin admin] Request method failure captured: Aug 26 15:50:14.268645 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 26 15:50:14.268645 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: Accept: application/json Aug 26 15:50:14.268645 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: Accept-Encoding: gzip, deflate Aug 26 15:50:14.268645 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: Connection: keep-alive Aug 26 15:50:14.268645 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: Content-Length: 0 Aug 26 15:50:14.268645 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: Host: 10.222.0.94 Aug 26 15:50:14.268645 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: Openstack-Api-Version: compute 2.90 Aug 26 15:50:14.268645 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: Openstack-System-Scope: None Aug 26 15:50:14.268645 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: User-Agent: python-novaclient Aug 26 15:50:14.268645 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Auth-Token: gAAAAABjCOu1Wp6Tw-fuTFeHrFdZFNPgjD7ShsnlosKZLJdL3BeTDOnGFFHutKhz-lyAQ5MdGgJp_ryaV6XhI3h6K0bmpb68ixseXlCLyRzf1ztc87a84s0lZzRfDAtzuamuQNipU4Gzs4yX3z-8luIPwWYs4nEDmno6yvtqycXP9eEEiJRrE-c Aug 26 15:50:14.268645 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Domain-Id: None Aug 26 15:50:14.268645 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Domain-Name: None Aug 26 15:50:14.268645 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Identity-Status: Confirmed Aug 26 15:50:14.268645 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Is-Admin-Project: True Aug 26 15:50:14.268645 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 15:50:14.268645 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Project-Domain-Id: default Aug 26 15:50:14.268645 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Project-Domain-Name: Default Aug 26 15:50:14.268645 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Project-Id: 27572d94c00243fdbbfd37ae021fbe77 Aug 26 15:50:14.268645 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Project-Name: admin Aug 26 15:50:14.268645 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Role: member,reader,admin Aug 26 15:50:14.268645 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Roles: member,reader,admin Aug 26 15:50:14.270432 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/27572d94c00243fdbbfd37ae021fbe77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/27572d94c00243fdbbfd37ae021fbe77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/27572d94c00243fdbbfd37ae021fbe77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_27572d94c00243fdbbfd37ae021fbe77", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 15:50:14.270432 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Tenant: admin Aug 26 15:50:14.270432 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Tenant-Id: 27572d94c00243fdbbfd37ae021fbe77 Aug 26 15:50:14.270432 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-Tenant-Name: admin Aug 26 15:50:14.270432 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-User: admin Aug 26 15:50:14.270432 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-User-Domain-Id: default Aug 26 15:50:14.270432 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-User-Domain-Name: Default Aug 26 15:50:14.270432 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-User-Id: 5f7a209666c0478690d711f7d361c03b Aug 26 15:50:14.270432 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: X-User-Name: admin Aug 26 15:50:14.270432 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: method: > Aug 26 15:50:14.270432 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: exception: Flavor 451 could not be found. Aug 26 15:50:14.270432 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: action_args: {'id': '451'} Aug 26 15:50:14.270432 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:50:14.270432 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:14.271386 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 15:50:14.271386 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 15:50:14.271386 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 15:50:14.271386 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 15:50:14.271386 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 15:50:14.271386 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 15:50:14.271386 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 15:50:14.271386 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 15:50:14.271386 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 15:50:14.271386 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:50:14.271386 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 15:50:14.271386 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 15:50:14.271386 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 26 15:50:14.271386 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi Aug 26 15:50:14.271386 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:14.271386 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi Aug 26 15:50:14.271386 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:14.271386 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:14.271386 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:14.272478 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:50:14.272478 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:50:14.272478 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:50:14.272478 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:50:14.272478 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 15:50:14.272478 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:50:14.272478 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 26 15:50:14.272478 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi Aug 26 15:50:14.272478 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:50:14.272478 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi Aug 26 15:50:14.272478 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:50:14.272478 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:50:14.272478 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:50:14.272478 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:50:14.272478 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:50:14.272478 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 26 15:50:14.272478 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: ERROR nova.api.openstack.wsgi Aug 26 15:50:14.272478 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-339ad379-abe4-49e7-95b0-cbe7000b0c10 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:50:14.273458 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-339ad379-abe4-49e7-95b0-cbe7000b0c10 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013424 Aug 26 15:50:14.277386 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 27/52] 10.222.0.94 () {60 vars in 1193 bytes} [Fri Aug 26 15:50:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 15:50:15.259740 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-28d4c9a3-a554-40f4-b9a0-94465528c3b2 admin admin] Calling method '>' {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:15.260762 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-28d4c9a3-a554-40f4-b9a0-94465528c3b2 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 26 15:50:15.261161 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 26/53] 10.222.0.94 () {56 vars in 1074 bytes} [Fri Aug 26 15:50:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:15.801642 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-ecc69b50-b176-4a16-999f-ca2208a6a69f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:50:15.882736 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-ecc69b50-b176-4a16-999f-ca2208a6a69f admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.481662 Aug 26 15:50:15.883314 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 28/54] 10.222.0.94 () {64 vars in 1235 bytes} [Fri Aug 26 15:50:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:50:16.974889 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-28d4c9a3-a554-40f4-b9a0-94465528c3b2 admin admin] Calling method '>' {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:16.975927 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-28d4c9a3-a554-40f4-b9a0-94465528c3b2 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 26 15:50:16.976325 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 27/55] 10.222.0.94 () {56 vars in 1074 bytes} [Fri Aug 26 15:50:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:17.522854 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-69ab09e3-85bd-4819-9cbb-1381baa20703 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:50:17.608775 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-69ab09e3-85bd-4819-9cbb-1381baa20703 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.487726 Aug 26 15:50:17.609326 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 29/56] 10.222.0.94 () {64 vars in 1235 bytes} [Fri Aug 26 15:50:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:50:18.597125 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-28d4c9a3-a554-40f4-b9a0-94465528c3b2 admin admin] Calling method '>' {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:18.598896 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-28d4c9a3-a554-40f4-b9a0-94465528c3b2 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002191 Aug 26 15:50:18.599322 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 28/57] 10.222.0.94 () {56 vars in 1074 bytes} [Fri Aug 26 15:50:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:19.129210 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-36ac7f73-9ad4-4ab4-bd5a-8ebf319d1646 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:50:19.203213 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-36ac7f73-9ad4-4ab4-bd5a-8ebf319d1646 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.465386 Aug 26 15:50:19.203756 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 30/58] 10.222.0.94 () {64 vars in 1235 bytes} [Fri Aug 26 15:50:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:50:20.190293 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-28d4c9a3-a554-40f4-b9a0-94465528c3b2 admin admin] Calling method '>' {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:20.191359 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-28d4c9a3-a554-40f4-b9a0-94465528c3b2 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 26 15:50:20.191785 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 29/59] 10.222.0.94 () {56 vars in 1074 bytes} [Fri Aug 26 15:50:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:20.723880 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-0f2d1573-6768-4e1d-8061-37f4c4178b61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:50:20.809241 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-0f2d1573-6768-4e1d-8061-37f4c4178b61 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.479685 Aug 26 15:50:20.809789 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 31/60] 10.222.0.94 () {64 vars in 1235 bytes} [Fri Aug 26 15:50:20 2022] POST /compute/v2.1/flavors => generated 409 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:50:21.791891 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-28d4c9a3-a554-40f4-b9a0-94465528c3b2 admin admin] Calling method '>' {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:21.792915 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-28d4c9a3-a554-40f4-b9a0-94465528c3b2 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 26 15:50:21.793313 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 30/61] 10.222.0.94 () {56 vars in 1074 bytes} [Fri Aug 26 15:50:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:50:22.326282 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-4778d0b5-1b43-4f9d-ba08-68261622a3c2 admin admin] Calling method '>' {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:50:22.346847 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-4778d0b5-1b43-4f9d-ba08-68261622a3c2 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.415622 Aug 26 15:50:22.347425 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 32/62] 10.222.0.94 () {60 vars in 1202 bytes} [Fri Aug 26 15:50:21 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:51:16.656999 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-28d4c9a3-a554-40f4-b9a0-94465528c3b2 admin admin] Calling method '>' {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:16.659079 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-28d4c9a3-a554-40f4-b9a0-94465528c3b2 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002112 Aug 26 15:51:16.659565 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 31/63] 10.222.0.94 () {54 vars in 931 bytes} [Fri Aug 26 15:51:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:51:16.670589 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG dbcounter [-] [112865] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:51:17.077500 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-1996bf06-318c-4ec4-b1c5-94c352961d82 admin admin] Calling method '>' {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:17.099360 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-1996bf06-318c-4ec4-b1c5-94c352961d82 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.433293 Aug 26 15:51:17.099830 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 33/64] 10.222.0.94 () {60 vars in 1292 bytes} [Fri Aug 26 15:51:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:51:17.120895 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG dbcounter [-] [112864] Writing DB stats nova_api:SELECT=14 {{(pid=112864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:51:17.125089 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-5bfedfd2-940a-4b76-b072-af311d93228c admin admin] Calling method '>' {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:17.133513 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-5bfedfd2-940a-4b76-b072-af311d93228c admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014239 Aug 26 15:51:17.139213 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 32/65] 10.222.0.94 () {60 vars in 1283 bytes} [Fri Aug 26 15:51:17 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:51:17.146821 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-fa108988-0d08-4225-84ff-275662105ada admin admin] Calling method '>' {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:17.154494 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-fa108988-0d08-4225-84ff-275662105ada admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011471 Aug 26 15:51:17.155042 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 34/66] 10.222.0.94 () {60 vars in 1286 bytes} [Fri Aug 26 15:51:17 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:17.167135 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-f6d8f663-d64c-427c-b2f7-1f107ad92e47 admin admin] Calling method '>' {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:17.175296 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-f6d8f663-d64c-427c-b2f7-1f107ad92e47 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011729 Aug 26 15:51:17.175818 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 33/67] 10.222.0.94 () {60 vars in 1286 bytes} [Fri Aug 26 15:51:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:51:17.187427 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-2756f73e-80d4-4faf-9763-0aa1ccc63faa admin admin] Calling method '>' {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:51:17.195781 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-2756f73e-80d4-4faf-9763-0aa1ccc63faa admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011883 Aug 26 15:51:17.200659 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 35/68] 10.222.0.94 () {60 vars in 1283 bytes} [Fri Aug 26 15:51:17 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:54:34.292621 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-f6d8f663-d64c-427c-b2f7-1f107ad92e47 admin admin] Calling method '>' {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:34.293709 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-f6d8f663-d64c-427c-b2f7-1f107ad92e47 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Aug 26 15:54:34.294113 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 34/69] 10.222.0.94 () {56 vars in 1074 bytes} [Fri Aug 26 15:54:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:54:34.441493 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG dbcounter [-] [112865] Writing DB stats nova_api:SELECT=6 {{(pid=112865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:54:34.605483 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-d6fdf129-c611-45c7-968d-c91b97ae3354 admin admin] Calling method '>' {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:34.608961 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-d6fdf129-c611-45c7-968d-c91b97ae3354 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:34.609439 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-d6fdf129-c611-45c7-968d-c91b97ae3354 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:34.609868 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-d6fdf129-c611-45c7-968d-c91b97ae3354 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:34.610614 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-d6fdf129-c611-45c7-968d-c91b97ae3354 admin admin] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:34.611103 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-d6fdf129-c611-45c7-968d-c91b97ae3354 admin admin] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:34.611525 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-d6fdf129-c611-45c7-968d-c91b97ae3354 admin admin] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:34.644778 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-d6fdf129-c611-45c7-968d-c91b97ae3354 admin admin] 10.222.0.94 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.204684 Aug 26 15:54:34.645899 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 36/70] 10.222.0.94 () {60 vars in 1193 bytes} [Fri Aug 26 15:54:34 2022] GET /compute/v2.1/os-services => generated 791 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:54:35.502223 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-f6d8f663-d64c-427c-b2f7-1f107ad92e47 admin admin] Calling method '>' {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:35.503295 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-f6d8f663-d64c-427c-b2f7-1f107ad92e47 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 26 15:54:35.503772 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 35/71] 10.222.0.94 () {56 vars in 1074 bytes} [Fri Aug 26 15:54:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:54:35.700967 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-a4413be3-ed31-409d-9b77-c433ac77ed62 admin admin] Calling method '>' {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:35.704456 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-a4413be3-ed31-409d-9b77-c433ac77ed62 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:35.704940 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-a4413be3-ed31-409d-9b77-c433ac77ed62 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:35.705431 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-a4413be3-ed31-409d-9b77-c433ac77ed62 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:35.706185 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-a4413be3-ed31-409d-9b77-c433ac77ed62 admin admin] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:35.706654 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-a4413be3-ed31-409d-9b77-c433ac77ed62 admin admin] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:35.707113 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-a4413be3-ed31-409d-9b77-c433ac77ed62 admin admin] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:35.727700 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-a4413be3-ed31-409d-9b77-c433ac77ed62 admin admin] 10.222.0.94 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079986 Aug 26 15:54:35.728203 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 37/72] 10.222.0.94 () {60 vars in 1193 bytes} [Fri Aug 26 15:54:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:54:46.959405 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-f6d8f663-d64c-427c-b2f7-1f107ad92e47 admin admin] Calling method '>' {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:46.960432 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-f6d8f663-d64c-427c-b2f7-1f107ad92e47 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 26 15:54:46.960836 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 36/73] 10.222.0.94 () {56 vars in 1074 bytes} [Fri Aug 26 15:54:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:54:47.107298 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG dbcounter [-] [112865] Writing DB stats nova_cell0:SELECT=4 {{(pid=112865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:54:47.108014 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG dbcounter [-] [112865] Writing DB stats nova_cell1:SELECT=4 {{(pid=112865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:54:47.108756 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG dbcounter [-] [112865] Writing DB stats nova_api:SELECT=8 {{(pid=112865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:54:47.158396 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-0d2f1ce4-60e9-451b-bf1f-46f654a146c7 admin admin] Calling method '>' {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:47.162101 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-0d2f1ce4-60e9-451b-bf1f-46f654a146c7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:47.162582 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-0d2f1ce4-60e9-451b-bf1f-46f654a146c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:47.163047 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-0d2f1ce4-60e9-451b-bf1f-46f654a146c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:47.163760 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-0d2f1ce4-60e9-451b-bf1f-46f654a146c7 admin admin] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:47.164206 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-0d2f1ce4-60e9-451b-bf1f-46f654a146c7 admin admin] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:47.164627 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-0d2f1ce4-60e9-451b-bf1f-46f654a146c7 admin admin] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:47.190730 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-0d2f1ce4-60e9-451b-bf1f-46f654a146c7 admin admin] 10.222.0.94 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087781 Aug 26 15:54:47.191268 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 38/74] 10.222.0.94 () {60 vars in 1193 bytes} [Fri Aug 26 15:54:47 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:54:48.039229 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: DEBUG nova.api.openstack.wsgi [None req-f6d8f663-d64c-427c-b2f7-1f107ad92e47 admin admin] Calling method '>' {{(pid=112864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:48.040241 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: INFO nova.api.openstack.requestlog [None req-f6d8f663-d64c-427c-b2f7-1f107ad92e47 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Aug 26 15:54:48.040637 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: [pid: 112864|app: 0|req: 37/75] 10.222.0.94 () {56 vars in 1074 bytes} [Fri Aug 26 15:54:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:54:48.233775 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG nova.api.openstack.wsgi [None req-8004a03e-d175-418a-9f17-121207ff41cb admin admin] Calling method '>' {{(pid=112865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:54:48.237190 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-8004a03e-d175-418a-9f17-121207ff41cb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:48.237667 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-8004a03e-d175-418a-9f17-121207ff41cb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:48.238092 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-8004a03e-d175-418a-9f17-121207ff41cb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:48.239025 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-8004a03e-d175-418a-9f17-121207ff41cb admin admin] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:54:48.239474 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-8004a03e-d175-418a-9f17-121207ff41cb admin admin] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:54:48.239891 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: DEBUG oslo_concurrency.lockutils [None req-8004a03e-d175-418a-9f17-121207ff41cb admin admin] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:54:48.261819 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: INFO nova.api.openstack.requestlog [None req-8004a03e-d175-418a-9f17-121207ff41cb admin admin] 10.222.0.94 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080690 Aug 26 15:54:48.262305 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: [pid: 112865|app: 0|req: 39/76] 10.222.0.94 () {60 vars in 1193 bytes} [Fri Aug 26 15:54:48 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:55:48.566768 dv-cinder-851449-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 26 15:55:48.567365 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: Fri Aug 26 15:55:48 2022 - graceful shutdown triggered... Aug 26 15:55:48.567797 dv-cinder-851449-7-iscsi devstack@n-api.service[112865]: Gracefully killing worker 2 (pid: 112865)... Aug 26 15:55:48.568183 dv-cinder-851449-7-iscsi devstack@n-api.service[112864]: Gracefully killing worker 1 (pid: 112864)... Aug 26 15:55:49.568217 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: worker 1 buried after 1 seconds Aug 26 15:55:49.568667 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: worker 2 buried after 1 seconds Aug 26 15:55:49.568667 dv-cinder-851449-7-iscsi devstack@n-api.service[112863]: goodbye to uWSGI. Aug 26 15:55:49.569759 dv-cinder-851449-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 26 15:55:49.570322 dv-cinder-851449-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 26 15:55:49.573144 dv-cinder-851449-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 26 15:55:49.584046 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 26 15:55:49.586077 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 26 15:55:49 2022] *** Aug 26 15:55:49.586077 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 26 15:55:49.586077 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 26 15:55:49.586077 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: nodename: dv-cinder-851449-7-iscsi Aug 26 15:55:49.586077 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: machine: x86_64 Aug 26 15:55:49.586077 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: clock source: unix Aug 26 15:55:49.586077 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: pcre jit disabled Aug 26 15:55:49.586077 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: detected number of CPU cores: 4 Aug 26 15:55:49.586077 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: current working directory: / Aug 26 15:55:49.586077 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: detected binary path: /usr/bin/uwsgi-core Aug 26 15:55:49.586717 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: your processes number limit is 47680 Aug 26 15:55:49.586717 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: your memory page size is 4096 bytes Aug 26 15:55:49.586717 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: detected max file descriptor number: 2048 Aug 26 15:55:49.586717 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: lock engine: pthread robust mutexes Aug 26 15:55:49.586717 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: thunder lock: enabled Aug 26 15:55:49.586717 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 26 15:55:49.586717 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 26 15:55:49.626465 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: Python main interpreter initialized at 0x5639aa5949c0 Aug 26 15:55:49.626465 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: python threads support enabled Aug 26 15:55:49.626465 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: your server socket listen backlog is limited to 100 connections Aug 26 15:55:49.626465 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: your mercy for graceful operations on workers is 90 seconds Aug 26 15:55:49.627088 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: mapped 403077 bytes (393 KB) for 2 cores Aug 26 15:55:49.627088 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: *** Operational MODE: preforking *** Aug 26 15:55:49.627209 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: *** uWSGI is running in multiple interpreter mode *** Aug 26 15:55:49.627209 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: spawned uWSGI master process (pid: 128290) Aug 26 15:55:49.627402 dv-cinder-851449-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 26 15:55:49.630773 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: spawned uWSGI worker 1 (pid: 128304, cores: 1) Aug 26 15:55:49.630773 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: spawned uWSGI worker 2 (pid: 128305, cores: 1) Aug 26 15:55:49.630773 dv-cinder-851449-7-iscsi devstack@n-api.service[128290]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 26 15:55:50.304229 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 15:55:50.304847 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 15:55:51.489803 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 15:55:51.489803 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: from cryptography.utils import int_from_bytes Aug 26 15:55:51.490470 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 15:55:51.490470 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: from cryptography.utils import int_from_bytes Aug 26 15:55:51.499176 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 15:55:51.499176 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: from cryptography.utils import int_from_bytes Aug 26 15:55:51.500446 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 15:55:51.500446 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: from cryptography.utils import int_from_bytes Aug 26 15:55:53.963953 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 15:55:53.964680 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 15:55:53.964776 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 15:55:53.965089 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 15:55:53.965348 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 15:55:53.965741 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.966070 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.966396 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.966727 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.967229 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.967548 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.967874 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.968197 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.968531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.968795 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.969113 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.969440 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851449-7-iscsi {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.969905 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.972452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.972452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.972452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.972690 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 15:55:53.973061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.973152 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 15:55:53.973225 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.973300 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 15:55:53.973369 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.973443 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 15:55:53.973518 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.973614 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 15:55:53.973614 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.973757 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.973757 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.973931 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.974019 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.974096 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.974173 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.974253 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.974332 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.974410 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.974491 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.974568 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.974644 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.974713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.974787 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.975076 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.975221 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.975427 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.975536 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.975675 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.975868 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851449-7-iscsi {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.976006 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.976193 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.976311 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851449-7-iscsi {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.976511 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.976610 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.976845 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.976951 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.977210 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.977385 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.977535 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.977684 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.977824 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.977979 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.978132 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.978276 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.978429 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.978582 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.978761 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.978904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.979126 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.979227 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.979448 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.979550 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.979771 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.979869 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.980093 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.980190 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.980399 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.980492 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.980741 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.980833 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.981054 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.981144 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.981365 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.981468 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.981670 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.981791 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.981979 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.982087 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.982235 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.982360 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851449-7-iscsi {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.982541 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.982673 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.982865 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.983051 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.983213 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.983312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.983536 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.983709 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.983866 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.984019 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.984120 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.984329 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.984428 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.984648 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.984791 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.984957 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.985060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.985261 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.985908 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.986189 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.986345 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.986448 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.986555 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.986794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.986970 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.987133 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.987297 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.987443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.987603 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.987754 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.987912 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.988075 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.988220 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.988392 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.988536 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.988714 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.988841 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.989025 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.989147 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.989350 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.989451 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.989688 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.989784 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.94 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.989991 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.94 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.990091 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.990301 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.990392 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.990624 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.990725 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.990861 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.991012 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.991156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.991277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.991444 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.991601 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.991764 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.991923 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.992071 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.992232 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.992384 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.992563 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.992671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.992847 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.992986 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.993168 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.993275 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.993507 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.993616 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.993812 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.993961 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.994056 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.994239 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.994386 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.994474 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.994645 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.994742 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.994987 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.995103 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.995297 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.995397 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.995606 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.995704 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.995916 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.996079 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.94 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.996232 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.996375 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.94 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.996512 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.996608 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.996845 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.996981 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.997135 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.997273 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.997443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.997544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.997751 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.997851 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.998058 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.998157 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.998366 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.998466 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.998672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.998763 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.998998 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.999103 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.999322 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.999413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.999643 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.999736 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:53.999951 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.000048 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.000199 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.000298 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.000503 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.000600 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.000806 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.000956 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.001719 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.001899 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.002043 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.002267 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.002407 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.002576 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.002669 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.002886 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.002997 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.003215 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.003308 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.003523 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.003604 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.003832 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.003918 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.004137 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.004231 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.004443 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.004522 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.004749 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.004829 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.005053 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.005141 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.005358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.005449 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.005662 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.005766 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.006183 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.006280 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.006280 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.006421 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.006554 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.006645 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.006867 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.006984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.007199 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.007306 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.007551 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.007645 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.007804 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.007893 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.008106 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.008198 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.008414 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.008494 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.008720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.008799 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.009034 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.009182 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.009337 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.009478 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.009640 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.009734 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.009964 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.010080 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.010268 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.010374 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.010575 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.010679 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.010897 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.011076 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.011226 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.011339 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.011531 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.011633 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.011847 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.011940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.012154 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.012244 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.012461 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.012559 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.012765 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.012864 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.013067 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.013157 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.013370 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.013475 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.013674 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.013771 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.013974 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.014065 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.014278 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.014378 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.014575 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.014666 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.014890 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.015042 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.015287 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.015394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.015596 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.015686 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.015903 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.015999 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.016208 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.016312 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.016526 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:55:54.016668 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.016885 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.017058 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.017235 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.017337 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.017578 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.017681 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.017893 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.017992 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.018225 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.018331 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.018556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.018704 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.018874 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.019036 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.019215 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.019392 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.019518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.019617 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.019842 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.019935 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.020153 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.020327 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.020466 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.020558 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.020781 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.020879 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.021102 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.021226 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.021421 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.021518 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.021735 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.021838 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.022054 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.022157 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.022370 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.022471 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.022684 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.022784 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.023020 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.023115 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.023336 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.023432 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.023652 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.023749 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.023970 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.024071 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.024281 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.024384 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.024606 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.024707 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.024926 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.025020 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.025241 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.025335 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.025561 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.025667 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.025876 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.025970 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.026190 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.026289 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.026502 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.026613 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.026810 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.026904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.027145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.027262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.027455 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.027559 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.027767 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.027979 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.028115 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.028239 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.028387 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.028493 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.028711 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.028803 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.029020 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.029108 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.029385 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.029501 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.029637 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.029755 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.029937 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.030038 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.030249 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.030348 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.030559 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.030648 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.030867 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.031005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.031211 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.031316 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.031527 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.031622 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.031836 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.031936 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.032154 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.032284 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.032587 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.032790 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.032892 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.033106 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.033217 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.033435 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.033545 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.033750 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.033851 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.034064 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.034160 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.034382 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.034475 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.034691 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.034792 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.035026 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.035122 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.035344 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.035439 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.035653 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.035746 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.035979 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.036073 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.036285 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.036386 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.036600 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.036702 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.036913 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.037018 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.037224 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.037329 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.037530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.037638 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.037843 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.037947 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.038156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.038250 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.038463 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.038567 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.038786 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.038898 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.039126 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.039228 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.039503 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.039627 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.039767 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.039886 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.040036 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.040171 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.040345 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.040456 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.040651 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.040743 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.040964 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.041065 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.041289 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.041433 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.041580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.041672 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.041888 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.041978 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.042212 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.042310 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.042524 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.042621 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.042833 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.042956 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.043171 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.043270 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.043481 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.043572 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.043807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.043897 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.044134 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.044226 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.044460 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.044550 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.044780 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.044880 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.045085 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.045176 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.045396 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.045488 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.045703 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.045809 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.046009 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.046106 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.046314 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.046404 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.046625 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.046726 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.046958 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.047054 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.047261 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.047351 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.047568 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.047672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.048432 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.048597 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.048764 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.048923 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.049082 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.049347 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.049442 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.049657 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.049768 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.049960 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.050135 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.050262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.050353 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.050597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.050689 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.050911 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.051042 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.051274 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.051365 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.051611 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.051706 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.051929 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.052033 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.052256 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.052353 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.052566 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.052654 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.052883 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.052981 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.053190 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.053287 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.053502 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.053592 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.053812 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.053902 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.054125 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.054216 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.054446 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.054542 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.054760 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.054911 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.055104 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.055204 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.055416 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.055515 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.055740 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.055840 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.056051 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.056142 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.056389 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.056485 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.056679 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.056777 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.056995 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.057092 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.057333 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.057434 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.057665 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.057757 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.057976 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.058073 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.058295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.058397 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.058604 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.058704 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.058942 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.059048 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.059254 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.059360 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.059567 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.059678 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.059880 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.060017 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.060183 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.060317 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.060496 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.060606 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.060811 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.060915 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.061131 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.061222 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.061444 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.061536 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.061752 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.061849 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.062063 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.062153 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.062374 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.062471 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.062678 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.062766 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.063013 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.063120 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.063331 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.063429 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.063717 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.063896 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.064057 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.064291 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.064462 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.064602 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.064694 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.064929 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.065020 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.065242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.065332 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.065555 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.065658 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.065865 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.065964 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.066170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.066259 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.066476 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.066565 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.066784 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.066882 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.067127 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.067235 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.067439 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.067537 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.067749 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.067850 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.068055 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.068153 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.068369 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.068475 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.068678 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.068777 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.068984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.069074 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.069294 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.069412 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.069604 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.069694 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.069928 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.070077 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.070242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.070349 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.070551 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.070639 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.070869 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.071019 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.071201 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.071309 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.071509 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.071607 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.071824 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.071915 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.072133 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.072232 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.072439 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.072528 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.072744 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.072832 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.073050 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.073141 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.073357 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.073453 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.073670 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.073761 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.073991 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.074081 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.074309 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.074566 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.074665 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.074904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.075078 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.075247 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.075339 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.075555 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.075651 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.075865 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.075964 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.076189 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.076280 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.076504 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.076614 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.076814 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.076904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.077127 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.077219 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.077438 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.077529 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.077750 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.077839 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.078057 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.078168 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.078370 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.078460 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.078675 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.078764 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.079003 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.079609 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.079871 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.080537 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.080681 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.080795 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.080888 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.080986 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.081078 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.081303 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.081593 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.081692 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.081911 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.082089 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.082222 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.082323 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.082540 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.082637 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.082847 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.082956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.083188 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.083280 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.083501 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.083612 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.083829 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.083920 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.084141 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.084240 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.084448 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.084540 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.084754 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.084852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.085060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.085159 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.085366 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.085457 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.085676 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.085774 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.085980 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.086082 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.086286 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.086377 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.086591 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.086682 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.086901 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.087119 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.087291 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.087382 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.087599 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.087689 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.087903 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.088072 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.088209 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.088310 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.088516 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.088614 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.088817 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.088915 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.089127 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.089225 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.089431 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.089521 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.089744 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.089835 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.090051 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.090166 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.090359 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.090469 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.090667 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.090750 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.090996 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.091083 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.091312 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.091403 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.091621 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.091715 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.091941 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.092032 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.092256 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.092358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.092566 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.092658 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.092874 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.092966 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.093189 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.093289 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.093503 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.093605 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.093810 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.093900 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.094117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.094216 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.094422 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.094520 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.094835 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.095067 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.095229 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.095407 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.095527 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.095774 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.095876 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.096083 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.096182 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.096396 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.096486 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.096706 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.096797 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.097012 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.097113 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.097329 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.097445 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.097634 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.097741 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.097943 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.098054 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.098253 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.098344 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.098560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.098651 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.098865 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.099007 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.099200 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.099298 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.099506 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.099604 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.099810 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.099903 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.100119 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.100260 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.100425 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.100525 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.100742 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.100875 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.101048 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.101141 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.101352 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.101444 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.101657 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.101756 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.101967 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.102058 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.102273 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.102370 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.102578 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.102670 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.102885 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.103018 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.103218 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.103327 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.103521 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.103610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.103828 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.103919 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.104137 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.104242 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.104443 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.104535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.104748 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.104846 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.105053 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.105167 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.105377 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.105490 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.105696 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.105809 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.106006 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.106132 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.106350 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.106658 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.106748 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.106987 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.107107 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.107299 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.107392 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.107609 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.107709 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.107915 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.108021 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.108221 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.108320 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.108528 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.108626 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.108833 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.108933 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.109140 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.109239 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.109464 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.109555 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.109774 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.109877 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.110077 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.110173 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.111012 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.111136 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.111407 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.111512 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.111694 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.111821 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.112000 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.112135 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.112361 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.112454 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.112670 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.112762 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.112990 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.113089 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.113304 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.113396 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.113615 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.113712 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.113926 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.114024 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.114240 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.114331 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.114546 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.114637 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.114862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.114995 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.115202 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.115301 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.115518 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.115608 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.115822 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.115922 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.116129 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.116228 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.116438 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.116528 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.116749 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.116854 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.117059 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.117158 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.117376 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.117467 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.117695 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.117870 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.118007 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.118106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.118309 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.118399 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.118619 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.118719 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.119021 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.119121 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.119257 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.119349 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.119561 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.119652 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.119868 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.119997 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.120180 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.120313 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.120491 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.120630 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.120804 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.120939 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.121177 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.121292 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.121492 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.121638 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.121735 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.121858 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.122030 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.122181 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.122340 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.122493 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.122644 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.122933 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.123029 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.123254 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.123356 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.123571 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.123670 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.123887 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.123986 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.124191 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.124289 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.124496 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.124587 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.124799 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.124896 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.125128 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.125226 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.125438 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.125529 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.125746 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.125838 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.126104 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.126293 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.126483 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.126644 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.126768 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.126907 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.127059 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.127247 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.127485 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.127585 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.127803 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.127906 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.128114 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.128265 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.128535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.128635 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.128853 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.128955 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.129167 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.129266 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.129473 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.129563 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.129779 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.129885 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.130092 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.130189 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.130415 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.130554 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.130719 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.130810 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.131051 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.131184 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.131364 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.131496 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.131692 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.131797 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.131999 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.132102 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.132314 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.132405 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.132622 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.132714 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.132949 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.133056 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.133277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.133370 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.133595 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.133721 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.133923 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.134022 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.134330 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.134422 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.134654 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.134746 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.134991 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.135084 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.135316 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.135415 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.135624 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.135723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.135940 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.136044 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.136249 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.136340 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.136564 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.136656 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.136874 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.136980 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.137184 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.137276 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.137500 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.137599 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.137806 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.137945 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.138121 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.138241 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.138438 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.138540 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.138751 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.138859 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.139082 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.139175 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.139393 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.139492 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.139739 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.140093 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.140197 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.140291 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.140377 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.140466 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.140636 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.140720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.140964 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.141056 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.141330 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.141446 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.142518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.142694 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.142856 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.142856 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.143099 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.143192 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.143290 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.143447 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.143542 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.143759 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.143857 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.144069 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.144161 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.144381 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.144491 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.144685 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.144787 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.144993 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.145087 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.145320 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.145412 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.145627 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.145718 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.145952 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.146045 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.146269 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.146360 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.146591 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.146684 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.146915 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.147038 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.147244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.147335 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.147571 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.147676 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.147879 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.147976 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.148183 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.148283 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.148492 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.148595 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.148797 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.148895 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.149108 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.149208 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.149417 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.149520 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.149731 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.149824 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.150039 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.150139 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.150349 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.150454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.150657 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.150802 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.151022 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.151150 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.151459 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.151574 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.151658 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.151731 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.151984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.152101 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.152360 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.152491 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.152585 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.152663 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.152893 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.152999 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.153202 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.153297 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.153508 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.153607 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.153814 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.153914 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.154120 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.154213 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.154428 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.154528 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.154733 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.154876 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.155063 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.155169 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.155369 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.155469 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.155714 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.155827 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.156019 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.156118 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.156342 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.156452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.156653 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.156755 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.156957 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.157057 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.157398 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.157550 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.157721 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.157897 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.158037 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.158155 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.158471 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.158568 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.158803 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.158896 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.159142 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.159245 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.159468 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.159568 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.159789 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.159890 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.160106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.160205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.160425 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.160529 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.160742 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.160872 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.161058 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.161149 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.161372 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.161529 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.161687 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.161788 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.161996 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.162097 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.162329 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.162469 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.162635 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.162749 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.162972 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.163123 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.163306 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.163625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.163808 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.163943 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.164151 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.164245 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.164478 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.164607 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.164799 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.164927 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.165119 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.165242 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.165439 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.165561 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.165759 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.165881 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.166077 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.166197 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.166395 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.166496 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.166710 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.166803 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.167050 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.167167 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.167383 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.167476 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.167709 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.167800 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.168038 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.168138 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.168352 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.168452 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.168672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.168765 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.168987 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.169088 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.169304 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.169403 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.169621 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.169713 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.169936 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.170029 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.170253 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.170345 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.170572 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.170671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.170887 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.171120 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.171216 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.171442 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.171544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.171780 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.171876 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.172109 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.172208 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.172434 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.172584 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.172748 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.173556 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.173705 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.173867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.174031 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.174201 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.174395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.174491 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.174711 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.174817 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.175051 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.175149 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.175368 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.175462 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.175677 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.175778 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.176004 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.176105 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.176320 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.176420 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.176631 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.176722 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.177006 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.177151 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.177277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.177471 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.177808 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.177900 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.178137 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.178245 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.178462 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.178564 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.178780 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.178880 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.179130 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.179234 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.179461 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.179558 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.179769 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.179880 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.180076 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.180169 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.180388 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.180478 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.180697 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.180795 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.181003 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.181148 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.181317 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.181415 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.181627 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.181764 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.181936 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.182040 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.182249 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.182342 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.182561 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.182697 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.182868 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.183206 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.183336 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.183521 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.183639 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.183853 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.183963 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.184161 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.184262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.184469 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.184562 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.184776 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.184871 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.185092 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.185200 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.185400 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.185501 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.185706 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.185800 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.186012 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.186109 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.186317 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.186421 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.186630 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.186733 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.186974 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.187083 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.187266 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.187368 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.187572 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.187664 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.187880 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.187979 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.188186 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.188287 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.188544 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.188675 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.188912 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.189119 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.189293 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.189472 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.189717 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.189812 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.190033 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.190127 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.190358 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.190459 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.190671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.190764 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.191003 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.191142 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.191314 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.191411 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.191628 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.191742 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.191933 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.192037 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.192243 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.192344 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.192550 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.192813 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.192914 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.193152 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.193262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.193479 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.193584 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.193771 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.193884 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.194081 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.194198 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.194423 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.194521 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.194734 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.194830 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.195067 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.195163 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.195376 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.195482 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.195694 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.195789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.196006 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.196102 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.196318 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.196414 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.196629 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.196724 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.196943 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.197044 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.197256 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.197351 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.197571 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.197676 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.197885 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.198117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.198215 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.198454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.198557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.198775 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.198870 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.199122 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.199229 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.199438 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.199541 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.199753 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.199850 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.200059 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.200161 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.200370 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.200593 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.200683 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.200768 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.200998 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.201108 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.201318 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.201440 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.201637 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.201750 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.201951 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.202062 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.202322 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.202440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.202571 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.202682 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.202877 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.203054 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.203215 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.203333 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.203528 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.203633 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.203840 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.203942 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.204183 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.204286 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.204609 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.204712 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.204930 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.205045 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.205511 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.205621 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.205838 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.205931 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.206153 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.206246 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.206480 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.206623 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.206808 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.206911 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.207149 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.207263 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.207465 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.207563 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.207778 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.207870 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.208090 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.208193 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.208404 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.208495 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.208715 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.208814 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.209032 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.209137 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.209361 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.209471 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.209672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.209773 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.209976 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.210078 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.210287 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.210390 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.210642 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.210749 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.210955 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.211078 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.211252 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.211409 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.211561 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.211662 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.211871 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.211965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.212177 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.212310 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.212485 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.212590 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.212791 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.212890 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.213098 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.213224 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.213409 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.213511 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.213713 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.213814 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.214018 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.214118 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.214325 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.214432 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.214635 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.214751 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.214957 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.215066 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.215268 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.215376 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.215578 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.215671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.215885 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.215985 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.216192 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.216294 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.216503 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.216597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.216809 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.216901 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.217113 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.217207 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.217420 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.217513 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.217724 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.217862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.218030 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.218131 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.218334 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.218434 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.218642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.218737 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.218960 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.219115 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.219271 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.219372 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.219579 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.219693 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.220494 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.220762 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.220915 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.221029 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.221149 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.221271 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.221390 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.221522 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.221655 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.221748 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.221968 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.222072 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.222273 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.222368 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.222578 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.222669 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.222883 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.223030 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.223242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.223379 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.223577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.223671 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.223897 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.223999 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.224211 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.224303 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.224521 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.224619 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.224847 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.224951 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.225158 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.225251 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.225474 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.225574 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.225791 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.225885 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.226106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.226205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.226420 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.226531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.226732 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.226822 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.227075 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.227172 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.227392 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.227497 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.227706 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.227804 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.228017 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.228108 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.228332 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.228488 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.228644 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.228758 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.228965 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.229064 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.229284 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.229377 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.229597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.229743 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.229915 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.230015 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.230228 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.230323 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.230547 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.230638 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.230866 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.231019 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.231206 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.231306 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.231535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.231639 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.231850 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.231948 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.232161 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.232255 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.232474 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.232575 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.232786 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.232892 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.233098 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.233225 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.233362 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 15:55:54.233458 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.233712 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.234021 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.234336 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.234650 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.235018 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.235563 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.235785 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.236110 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.236435 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.236781 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.237094 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.237439 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.237768 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.238085 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.238398 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.238705 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:55:54.238968 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 15:55:54.296042 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO dbcounter [None req-6e9fe686-f261-4389-b792-f361d0e1176d None None] Registered counter for database nova_api Aug 26 15:55:54.301330 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO dbcounter [None req-6c23adc7-5206-439f-982b-de87f5e71712 None None] Registered counter for database nova_api Aug 26 15:55:54.317111 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_db.sqlalchemy.engines [None req-6e9fe686-f261-4389-b792-f361d0e1176d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:55:54.322033 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_db.sqlalchemy.engines [None req-6c23adc7-5206-439f-982b-de87f5e71712 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:55:54.323896 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writer thread running {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:55:54.328668 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writer thread running {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:55:54.388647 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.context [None req-6c23adc7-5206-439f-982b-de87f5e71712 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0b049a6f-4aea-43fa-a984-ec2d2c95e2da(cell1) {{(pid=128304) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 15:55:54.388992 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.context [None req-6e9fe686-f261-4389-b792-f361d0e1176d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0b049a6f-4aea-43fa-a984-ec2d2c95e2da(cell1) {{(pid=128305) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 15:55:54.394556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6c23adc7-5206-439f-982b-de87f5e71712 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:54.395130 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6c23adc7-5206-439f-982b-de87f5e71712 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:54.395268 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6e9fe686-f261-4389-b792-f361d0e1176d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:54.395695 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6e9fe686-f261-4389-b792-f361d0e1176d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:54.396746 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6c23adc7-5206-439f-982b-de87f5e71712 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:54.397320 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6e9fe686-f261-4389-b792-f361d0e1176d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:54.398257 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6e9fe686-f261-4389-b792-f361d0e1176d None None] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:54.398627 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6c23adc7-5206-439f-982b-de87f5e71712 None None] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:55:54.398750 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6e9fe686-f261-4389-b792-f361d0e1176d None None] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:54.399118 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6c23adc7-5206-439f-982b-de87f5e71712 None None] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:55:54.400787 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6e9fe686-f261-4389-b792-f361d0e1176d None None] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:54.401128 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6c23adc7-5206-439f-982b-de87f5e71712 None None] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:55:54.402861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO dbcounter [None req-6e9fe686-f261-4389-b792-f361d0e1176d None None] Registered counter for database nova_cell0 Aug 26 15:55:54.403185 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO dbcounter [None req-6c23adc7-5206-439f-982b-de87f5e71712 None None] Registered counter for database nova_cell0 Aug 26 15:55:54.407133 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO dbcounter [None req-6e9fe686-f261-4389-b792-f361d0e1176d None None] Registered counter for database nova_cell1 Aug 26 15:55:54.407292 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO dbcounter [None req-6c23adc7-5206-439f-982b-de87f5e71712 None None] Registered counter for database nova_cell1 Aug 26 15:55:54.414873 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_db.sqlalchemy.engines [None req-6e9fe686-f261-4389-b792-f361d0e1176d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:55:54.416441 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_db.sqlalchemy.engines [None req-6c23adc7-5206-439f-982b-de87f5e71712 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:55:54.418128 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_db.sqlalchemy.engines [None req-6e9fe686-f261-4389-b792-f361d0e1176d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:55:54.419730 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_db.sqlalchemy.engines [None req-6c23adc7-5206-439f-982b-de87f5e71712 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:55:54.425889 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writer thread running {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:55:54.426729 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writer thread running {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:55:54.427150 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writer thread running {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:55:54.573741 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writer thread running {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:55:54.581365 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO dbcounter [None req-6e9fe686-f261-4389-b792-f361d0e1176d None None] Registered counter for database nova_cell0 Aug 26 15:55:54.584741 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO dbcounter [None req-6c23adc7-5206-439f-982b-de87f5e71712 None None] Registered counter for database nova_cell0 Aug 26 15:55:54.588960 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_db.sqlalchemy.engines [None req-6e9fe686-f261-4389-b792-f361d0e1176d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:55:54.591209 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_db.sqlalchemy.engines [None req-6c23adc7-5206-439f-982b-de87f5e71712 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:55:54.593763 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writer thread running {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:55:54.596590 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writer thread running {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:55:54.923550 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: WARNING keystonemiddleware.auth_token [None req-6e9fe686-f261-4389-b792-f361d0e1176d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 15:55:54.924045 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: WARNING keystonemiddleware.auth_token [None req-6c23adc7-5206-439f-982b-de87f5e71712 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 15:55:54.930863 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: WARNING keystonemiddleware.auth_token [None req-6e9fe686-f261-4389-b792-f361d0e1176d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 15:55:54.931471 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: WARNING keystonemiddleware.auth_token [None req-6c23adc7-5206-439f-982b-de87f5e71712 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 15:55:55.279449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: WARNING keystonemiddleware.auth_token [None req-6c23adc7-5206-439f-982b-de87f5e71712 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 15:55:55.283481 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: WARNING keystonemiddleware.auth_token [None req-6e9fe686-f261-4389-b792-f361d0e1176d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 15:55:55.286067 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: WARNING keystonemiddleware.auth_token [None req-6c23adc7-5206-439f-982b-de87f5e71712 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 15:55:55.289488 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: WARNING keystonemiddleware.auth_token [None req-6e9fe686-f261-4389-b792-f361d0e1176d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 15:55:55.291352 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5639aa5949c0 pid: 128304 (default app) Aug 26 15:55:55.294749 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5639aa5949c0 pid: 128305 (default app) Aug 26 15:56:36.225650 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-59ff9ad9-0dff-498e-9eb5-fb8b74a53a8e tempest-VolumesTestJSON-560683472 tempest-VolumesTestJSON-560683472-project] Calling method '.version_select at 0x7f15da6e15e0>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:36.264134 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_api:SELECT=3 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:56:36.265442 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell0:SELECT=3 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:56:36.267190 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=3 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:56:36.268131 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell0:SELECT=3 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:56:36.844914 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-59ff9ad9-0dff-498e-9eb5-fb8b74a53a8e tempest-VolumesTestJSON-560683472 tempest-VolumesTestJSON-560683472-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/794fd82c-a6c2-4cb2-a914-1e1b5061c47f" status: 200 len: 351 microversion: 2.1 time: 0.918840 Aug 26 15:56:36.845749 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 1/1] 10.222.0.94 () {58 vars in 1245 bytes} [Fri Aug 26 15:56:35 2022] GET /compute/v2.1/os-volumes/794fd82c-a6c2-4cb2-a914-1e1b5061c47f => generated 351 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:56:39.463279 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-466f9add-9cd2-4ef5-9e49-abe767403b29 tempest-VolumesTestJSON-560683472 tempest-VolumesTestJSON-560683472-project] Calling method '.version_select at 0x7f15da6e1670>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:39.496214 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_api:SELECT=3 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:56:39.497425 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell0:SELECT=3 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:56:39.498355 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=3 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:56:39.500280 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell0:SELECT=3 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:56:40.005876 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-466f9add-9cd2-4ef5-9e49-abe767403b29 tempest-VolumesTestJSON-560683472 tempest-VolumesTestJSON-560683472-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/fa1c04e7-0b28-4e3c-aa1d-141e924bfb0b" status: 200 len: 350 microversion: 2.1 time: 0.947976 Aug 26 15:56:40.006540 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 1/2] 10.222.0.94 () {58 vars in 1245 bytes} [Fri Aug 26 15:56:39 2022] GET /compute/v2.1/os-volumes/fa1c04e7-0b28-4e3c-aa1d-141e924bfb0b => generated 350 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:56:43.981093 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-6801a5ad-51cb-4686-a247-51f919ccb019 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Action: 'create', calling method: .version_select at 0x7f15da4b5940>, body: {"keypair": {"name": "tempest-keypair-1810100575", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLloMAdnYNbIHogdRWGXYyLzDToaFkVPpT9GUS3Tvx5Kvnl5eEqMyCDS16WcuA8YvouUw/AJhpC9crfMVvifCQz+94Etn2/6hjPd/4FjhVFOdtRvyzgI7W6UxH8DB5n9iw=="}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:56:44.110369 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-6801a5ad-51cb-4686-a247-51f919ccb019 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Getting quotas for project d95f731096d74a089f4161f5db69280c. Resources: {'key_pairs'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:56:44.124429 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-6801a5ad-51cb-4686-a247-51f919ccb019 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Getting quotas for user b50041d36b0b430badd6442a2f09f063 and project d95f731096d74a089f4161f5db69280c. Resources: {'key_pairs'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:56:44.276555 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-6801a5ad-51cb-4686-a247-51f919ccb019 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.425347 Aug 26 15:56:44.278539 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 2/3] 10.222.0.94 () {60 vars in 1159 bytes} [Fri Aug 26 15:56:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:56:47.229883 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-636bbe4f-514b-4265-aa52-50d7f5896a30 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Action: 'create', calling method: .version_select at 0x7f15da4b3820>, body: {"keypair": {"name": "tempest-keypair-620682017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3C823h+c6EfgWoASOsOxAiVMhYklATz68t2Sn10HlIuzSIpSWk22X4YVAbWnzkHF12o3QSXhYqcnFq1U12frbBpPo0m3/BDJKDP2EY995MGiA4yO/ru0vk4xGhgLth/g=="}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:56:47.400585 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-636bbe4f-514b-4265-aa52-50d7f5896a30 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Getting quotas for project 8c69c9fb12124d72954b8ab7ad024175. Resources: {'key_pairs'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:56:47.425575 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-636bbe4f-514b-4265-aa52-50d7f5896a30 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Getting quotas for user 7069a9b54a3245b3ab9671730344e6d3 and project 8c69c9fb12124d72954b8ab7ad024175. Resources: {'key_pairs'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:56:47.699454 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-636bbe4f-514b-4265-aa52-50d7f5896a30 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.614199 Aug 26 15:56:47.716357 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 2/4] 10.222.0.94 () {60 vars in 1159 bytes} [Fri Aug 26 15:56:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:56:48.026797 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-5ca2aa32-de40-4978-8d6a-044a8e03c6a2 tempest-VolumesTestJSON-560683472 tempest-VolumesTestJSON-560683472-project] Calling method '.version_select at 0x7f15da3e9d30>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:48.165297 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-5ca2aa32-de40-4978-8d6a-044a8e03c6a2 tempest-VolumesTestJSON-560683472 tempest-VolumesTestJSON-560683472-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/b0c4094f-f9d8-42ed-a1c8-a39398ba2c0d" status: 200 len: 351 microversion: 2.1 time: 0.142633 Aug 26 15:56:48.166492 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 3/5] 10.222.0.94 () {58 vars in 1245 bytes} [Fri Aug 26 15:56:48 2022] GET /compute/v2.1/os-volumes/b0c4094f-f9d8-42ed-a1c8-a39398ba2c0d => generated 351 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:56:48.185987 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-6e149e47-7066-4341-b342-9d5ffa4cfe6f tempest-VolumesTestJSON-560683472 tempest-VolumesTestJSON-560683472-project] Calling method '.version_select at 0x7f15da3e3670>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:48.412312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-1e2b572d-6d1d-4023-a37a-f05345f6d953 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-951712071", "imageRef": "bcbdbb0c-7335-4427-a636-e2dc730274b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:56:48.457457 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-6e149e47-7066-4341-b342-9d5ffa4cfe6f tempest-VolumesTestJSON-560683472 tempest-VolumesTestJSON-560683472-project] 10.222.0.94 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.281558 Aug 26 15:56:48.458778 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 3/6] 10.222.0.94 () {58 vars in 1134 bytes} [Fri Aug 26 15:56:48 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:48.477406 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-d017bb07-8702-4ca7-95cb-23c494819700 tempest-VolumesTestJSON-560683472 tempest-VolumesTestJSON-560683472-project] Calling method '.version_select at 0x7f15da3e3550>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:48.662909 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.network.neutron [None req-1e2b572d-6d1d-4023-a37a-f05345f6d953 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] validate_networks() for [('a3e12d9a-1559-439b-ab2a-deef2d81938d', None, None, None, None, None)] {{(pid=128304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:56:48.732394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-d017bb07-8702-4ca7-95cb-23c494819700 tempest-VolumesTestJSON-560683472 tempest-VolumesTestJSON-560683472-project] 10.222.0.94 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.261177 Aug 26 15:56:48.738544 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 4/7] 10.222.0.94 () {58 vars in 1149 bytes} [Fri Aug 26 15:56:48 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:56:48.754158 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-0de959f6-97d4-4894-94ab-ce40a787cc57 tempest-VolumesTestJSON-560683472 tempest-VolumesTestJSON-560683472-project] Calling method '.version_select at 0x7f15da41be50>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:48.958178 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-0de959f6-97d4-4894-94ab-ce40a787cc57 tempest-VolumesTestJSON-560683472 tempest-VolumesTestJSON-560683472-project] 10.222.0.94 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.208994 Aug 26 15:56:48.958763 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 5/8] 10.222.0.94 () {58 vars in 1134 bytes} [Fri Aug 26 15:56:48 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:56:48.972224 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-bf7e1340-d617-4489-99dd-4389c86d4bee tempest-VolumesTestJSON-560683472 tempest-VolumesTestJSON-560683472-project] Calling method '.version_select at 0x7f15da41b280>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:49.136949 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-bf7e1340-d617-4489-99dd-4389c86d4bee tempest-VolumesTestJSON-560683472 tempest-VolumesTestJSON-560683472-project] 10.222.0.94 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.168260 Aug 26 15:56:49.146824 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 6/9] 10.222.0.94 () {58 vars in 1167 bytes} [Fri Aug 26 15:56:48 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:56:49.159588 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-3ad104c6-0e23-4e86-b527-1f7b0aa82d9b tempest-VolumesTestJSON-560683472 tempest-VolumesTestJSON-560683472-project] Calling method '.version_select at 0x7f15da4815e0>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:49.455725 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-3ad104c6-0e23-4e86-b527-1f7b0aa82d9b tempest-VolumesTestJSON-560683472 tempest-VolumesTestJSON-560683472-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.307076 Aug 26 15:56:49.457411 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 7/10] 10.222.0.94 () {58 vars in 1170 bytes} [Fri Aug 26 15:56:49 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:56:49.471914 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-75311715-1515-4e94-8c0d-7e7dfc204451 tempest-VolumesTestJSON-560683472 tempest-VolumesTestJSON-560683472-project] Calling method '.version_select at 0x7f15da3ab160>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:49.857148 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-75311715-1515-4e94-8c0d-7e7dfc204451 tempest-VolumesTestJSON-560683472 tempest-VolumesTestJSON-560683472-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.387120 Aug 26 15:56:49.868294 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 8/11] 10.222.0.94 () {58 vars in 1155 bytes} [Fri Aug 26 15:56:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:56:49.874785 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-1630baf5-ff4b-49d1-8d2a-aa24fbd446cd tempest-VolumesTestJSON-560683472 tempest-VolumesTestJSON-560683472-project] Calling method '.version_select at 0x7f15da3a3b80>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:50.144624 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-1630baf5-ff4b-49d1-8d2a-aa24fbd446cd tempest-VolumesTestJSON-560683472 tempest-VolumesTestJSON-560683472-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.274903 Aug 26 15:56:50.154848 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 9/12] 10.222.0.94 () {58 vars in 1188 bytes} [Fri Aug 26 15:56:49 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:56:50.166993 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-1a851177-200b-4afa-92ae-17a6d3484e47 tempest-VolumesTestJSON-560683472 tempest-VolumesTestJSON-560683472-project] Calling method '.version_select at 0x7f15da41b790>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:50.394722 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-1a851177-200b-4afa-92ae-17a6d3484e47 tempest-VolumesTestJSON-560683472 tempest-VolumesTestJSON-560683472-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.237984 Aug 26 15:56:50.396200 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 10/13] 10.222.0.94 () {58 vars in 1155 bytes} [Fri Aug 26 15:56:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:51.220316 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-1e2b572d-6d1d-4023-a37a-f05345f6d953 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Flavor limits 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:56:51.222411 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-1e2b572d-6d1d-4023-a37a-f05345f6d953 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Image limits 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:56:51.228122 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-1e2b572d-6d1d-4023-a37a-f05345f6d953 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Flavor pref 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:56:51.228623 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-1e2b572d-6d1d-4023-a37a-f05345f6d953 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Image pref 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:56:51.229061 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-1e2b572d-6d1d-4023-a37a-f05345f6d953 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:56:51.256819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1e2b572d-6d1d-4023-a37a-f05345f6d953 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:51.257305 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1e2b572d-6d1d-4023-a37a-f05345f6d953 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:51.257738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1e2b572d-6d1d-4023-a37a-f05345f6d953 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:51.266325 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1e2b572d-6d1d-4023-a37a-f05345f6d953 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:51.266828 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1e2b572d-6d1d-4023-a37a-f05345f6d953 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:51.268195 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1e2b572d-6d1d-4023-a37a-f05345f6d953 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:51.352644 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-1e2b572d-6d1d-4023-a37a-f05345f6d953 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Getting quotas for project 5f170813ecff47a68d7610de9d769287. Resources: {'instances', 'ram', 'cores'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:56:51.373325 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-1e2b572d-6d1d-4023-a37a-f05345f6d953 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Getting quotas for user 4940f8a9c15a483eab251df392789534 and project 5f170813ecff47a68d7610de9d769287. Resources: {'instances', 'ram', 'cores'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:56:51.407919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-1e2b572d-6d1d-4023-a37a-f05345f6d953 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Going to run 1 instances... {{(pid=128304) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:56:51.413390 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-1e2b572d-6d1d-4023-a37a-f05345f6d953 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bcbdbb0c-7335-4427-a636-e2dc730274b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:56:51.660124 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-1e2b572d-6d1d-4023-a37a-f05345f6d953 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.353815 Aug 26 15:56:51.672088 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 4/14] 10.222.0.94 () {60 vars in 1147 bytes} [Fri Aug 26 15:56:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 3367 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 15:56:51.679500 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-2c4b6a6b-d4de-43a9-8109-0316ceec8d89 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:51.681713 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-2c4b6a6b-d4de-43a9-8109-0316ceec8d89 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:52.293259 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-2c4b6a6b-d4de-43a9-8109-0316ceec8d89 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:52.324672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-2c4b6a6b-d4de-43a9-8109-0316ceec8d89 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1221 microversion: 2.1 time: 0.654706 Aug 26 15:56:52.325413 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 11/15] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:51 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1221 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:52.431502 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-cabb6546-4cc0-4a36-ba3e-597482d2522d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1951292960", "imageRef": "bcbdbb0c-7335-4427-a636-e2dc730274b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:56:52.538803 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.network.neutron [None req-cabb6546-4cc0-4a36-ba3e-597482d2522d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] validate_networks() for [('a3e12d9a-1559-439b-ab2a-deef2d81938d', None, None, None, None, None)] {{(pid=128304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:56:52.737678 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-ac3ce529-0c42-4457-88b5-7a9051850344 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1465168619", "imageRef": "bcbdbb0c-7335-4427-a636-e2dc730274b6", "flavorRef": "452", "networks": [{"uuid": "d87878b7-d9a3-45c4-aa08-3d8577af979f"}]}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:56:52.904371 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.network.neutron [None req-ac3ce529-0c42-4457-88b5-7a9051850344 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] validate_networks() for [('d87878b7-d9a3-45c4-aa08-3d8577af979f', None, None, None, None, None)] {{(pid=128305) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:56:54.096437 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-cabb6546-4cc0-4a36-ba3e-597482d2522d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Flavor limits 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:56:54.096957 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-cabb6546-4cc0-4a36-ba3e-597482d2522d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Image limits 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:56:54.097417 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-cabb6546-4cc0-4a36-ba3e-597482d2522d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Flavor pref 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:56:54.097824 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-cabb6546-4cc0-4a36-ba3e-597482d2522d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Image pref 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:56:54.098236 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-cabb6546-4cc0-4a36-ba3e-597482d2522d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:56:54.107237 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cabb6546-4cc0-4a36-ba3e-597482d2522d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:54.107729 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cabb6546-4cc0-4a36-ba3e-597482d2522d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:54.108676 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cabb6546-4cc0-4a36-ba3e-597482d2522d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:54.109428 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cabb6546-4cc0-4a36-ba3e-597482d2522d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:54.109921 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cabb6546-4cc0-4a36-ba3e-597482d2522d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:54.110353 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cabb6546-4cc0-4a36-ba3e-597482d2522d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:54.131347 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-cabb6546-4cc0-4a36-ba3e-597482d2522d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Getting quotas for project 5f170813ecff47a68d7610de9d769287. Resources: {'instances', 'ram', 'cores'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:56:54.135433 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-cabb6546-4cc0-4a36-ba3e-597482d2522d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Getting quotas for user 4940f8a9c15a483eab251df392789534 and project 5f170813ecff47a68d7610de9d769287. Resources: {'instances', 'ram', 'cores'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:56:54.147198 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-cabb6546-4cc0-4a36-ba3e-597482d2522d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Going to run 1 instances... {{(pid=128304) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:56:54.149510 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-cabb6546-4cc0-4a36-ba3e-597482d2522d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bcbdbb0c-7335-4427-a636-e2dc730274b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:56:54.194358 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-ac3ce529-0c42-4457-88b5-7a9051850344 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Flavor limits 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:56:54.194889 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-ac3ce529-0c42-4457-88b5-7a9051850344 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Image limits 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:56:54.195303 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-ac3ce529-0c42-4457-88b5-7a9051850344 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Flavor pref 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:56:54.195713 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-ac3ce529-0c42-4457-88b5-7a9051850344 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Image pref 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:56:54.196133 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-ac3ce529-0c42-4457-88b5-7a9051850344 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:56:54.205812 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ac3ce529-0c42-4457-88b5-7a9051850344 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:54.206534 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ac3ce529-0c42-4457-88b5-7a9051850344 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:54.207003 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ac3ce529-0c42-4457-88b5-7a9051850344 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:54.207722 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ac3ce529-0c42-4457-88b5-7a9051850344 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:54.208178 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ac3ce529-0c42-4457-88b5-7a9051850344 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:54.208601 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ac3ce529-0c42-4457-88b5-7a9051850344 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:54.243885 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-ac3ce529-0c42-4457-88b5-7a9051850344 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Getting quotas for project e649b58115ab4bcbbf045a3c036a3049. Resources: {'instances', 'ram', 'cores'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:56:54.252003 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-ac3ce529-0c42-4457-88b5-7a9051850344 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Getting quotas for user f56fcb6b073d4f1d9dabab1e0bac6ec3 and project e649b58115ab4bcbbf045a3c036a3049. Resources: {'instances', 'ram', 'cores'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:56:54.266600 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-ac3ce529-0c42-4457-88b5-7a9051850344 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Going to run 1 instances... {{(pid=128305) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:56:54.269393 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-ac3ce529-0c42-4457-88b5-7a9051850344 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bcbdbb0c-7335-4427-a636-e2dc730274b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128305) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:56:54.876507 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-cabb6546-4cc0-4a36-ba3e-597482d2522d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.449584 Aug 26 15:56:54.878295 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 5/16] 10.222.0.94 () {60 vars in 1147 bytes} [Fri Aug 26 15:56:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 2452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 15:56:54.929745 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-ac3ce529-0c42-4457-88b5-7a9051850344 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.324971 Aug 26 15:56:54.931078 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 12/17] 10.222.0.94 () {60 vars in 1147 bytes} [Fri Aug 26 15:56:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 15:56:54.939951 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-918cd49f-e3ba-402a-a5b2-c9840a41ffa8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:54.941797 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-918cd49f-e3ba-402a-a5b2-c9840a41ffa8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:55.047636 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-cec80f79-f7ee-4cb4-98e5-f6db76b587e3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Action: 'create', calling method: .version_select at 0x7f15da356a60>, body: {"keypair": {"name": "tempest-keypair-1446175540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8y6LyqeVK9n3iUeqTyko+kwamAbueo8U+DOQnG8x0seI7JeyKuX/96aFBIoc3qyAriAsoUZeUgNzO7kL7u8rJsifyjcGjSI0XhbMAjYhtZGKnFl3SQ00WMduvfwDWPVg=="}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:56:55.116391 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-cec80f79-f7ee-4cb4-98e5-f6db76b587e3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Getting quotas for project e8bfb4199b0d4a57933fe1b685aa01cd. Resources: {'key_pairs'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:56:55.152214 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-cec80f79-f7ee-4cb4-98e5-f6db76b587e3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Getting quotas for user 228837054cd648acb0df93dd423e1d83 and project e8bfb4199b0d4a57933fe1b685aa01cd. Resources: {'key_pairs'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:56:55.316910 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-cec80f79-f7ee-4cb4-98e5-f6db76b587e3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.436969 Aug 26 15:56:55.318302 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 6/18] 10.222.0.94 () {62 vars in 1200 bytes} [Fri Aug 26 15:56:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 439 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 26 15:56:55.338339 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-03973010-434b-49e1-89e5-e081ce6c6315 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:55.340602 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-03973010-434b-49e1-89e5-e081ce6c6315 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:55.722345 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-918cd49f-e3ba-402a-a5b2-c9840a41ffa8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:55.741626 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-918cd49f-e3ba-402a-a5b2-c9840a41ffa8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1222 microversion: 2.1 time: 0.808669 Aug 26 15:56:55.759654 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 13/19] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:54 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1222 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:55.787188 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-fcd78527-e775-4408-b1cf-1fa4bc8ead3a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1310113784", "imageRef": "bcbdbb0c-7335-4427-a636-e2dc730274b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62414327-5b31-4d4a-b372-9a9bbc06aa9d"}], "security_groups": [{"name": "tempest-securitygroup--346058195"}], "key_name": "tempest-keypair-1810100575", "user_data": "}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:56:55.850566 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-03973010-434b-49e1-89e5-e081ce6c6315 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:55.889947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-03973010-434b-49e1-89e5-e081ce6c6315 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1215 microversion: 2.1 time: 0.560304 Aug 26 15:56:55.902959 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 7/20] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:55 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1215 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:56.075763 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.network.neutron [None req-fcd78527-e775-4408-b1cf-1fa4bc8ead3a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] validate_networks() for [('62414327-5b31-4d4a-b372-9a9bbc06aa9d', None, None, None, None, None)] {{(pid=128305) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:56:56.776243 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-4cd6fcd0-5b58-4b49-af35-eb426e4dcf59 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:56.776879 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-4cd6fcd0-5b58-4b49-af35-eb426e4dcf59 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:56.998761 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-4cd6fcd0-5b58-4b49-af35-eb426e4dcf59 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:57.010033 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-4cd6fcd0-5b58-4b49-af35-eb426e4dcf59 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1222 microversion: 2.1 time: 0.247233 Aug 26 15:56:57.018664 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 8/21] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:56 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1222 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:57.057365 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-371c6937-bc07-4080-8a25-a5693172819e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:57.058682 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-371c6937-bc07-4080-8a25-a5693172819e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:57.249612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-fcd78527-e775-4408-b1cf-1fa4bc8ead3a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Flavor limits 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:56:57.256132 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-fcd78527-e775-4408-b1cf-1fa4bc8ead3a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Image limits 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:56:57.259278 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-fcd78527-e775-4408-b1cf-1fa4bc8ead3a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Flavor pref 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:56:57.259828 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-fcd78527-e775-4408-b1cf-1fa4bc8ead3a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Image pref 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:56:57.260251 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-fcd78527-e775-4408-b1cf-1fa4bc8ead3a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:56:57.301768 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fcd78527-e775-4408-b1cf-1fa4bc8ead3a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:57.302289 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fcd78527-e775-4408-b1cf-1fa4bc8ead3a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:57.302741 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fcd78527-e775-4408-b1cf-1fa4bc8ead3a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:57.308328 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fcd78527-e775-4408-b1cf-1fa4bc8ead3a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:57.308819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fcd78527-e775-4408-b1cf-1fa4bc8ead3a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:57.309434 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fcd78527-e775-4408-b1cf-1fa4bc8ead3a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:57.339528 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-371c6937-bc07-4080-8a25-a5693172819e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:57.355863 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-371c6937-bc07-4080-8a25-a5693172819e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1215 microversion: 2.1 time: 0.334787 Aug 26 15:56:57.356460 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 9/22] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:57 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1215 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:57.372784 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-4ed88385-15fe-4867-9ad1-e96d090e995b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1827344213", "imageRef": "bcbdbb0c-7335-4427-a636-e2dc730274b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46346453-7c70-4f46-80a8-f812b7507006"}], "security_groups": [{"name": "tempest-securitygroup--1391856753"}], "key_name": "tempest-keypair-620682017", "user_data": "}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:56:57.398854 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-fcd78527-e775-4408-b1cf-1fa4bc8ead3a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Getting quotas for project d95f731096d74a089f4161f5db69280c. Resources: {'instances', 'ram', 'cores'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:56:57.403199 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-fcd78527-e775-4408-b1cf-1fa4bc8ead3a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Getting quotas for user b50041d36b0b430badd6442a2f09f063 and project d95f731096d74a089f4161f5db69280c. Resources: {'instances', 'ram', 'cores'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:56:57.508149 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-fcd78527-e775-4408-b1cf-1fa4bc8ead3a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Going to run 1 instances... {{(pid=128305) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:56:57.510367 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-fcd78527-e775-4408-b1cf-1fa4bc8ead3a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bcbdbb0c-7335-4427-a636-e2dc730274b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128305) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:56:57.649762 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.network.neutron [None req-4ed88385-15fe-4867-9ad1-e96d090e995b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] validate_networks() for [('46346453-7c70-4f46-80a8-f812b7507006', None, None, None, None, None)] {{(pid=128304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:56:57.776708 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-fcd78527-e775-4408-b1cf-1fa4bc8ead3a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.015816 Aug 26 15:56:57.785540 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 14/23] 10.222.0.94 () {60 vars in 1147 bytes} [Fri Aug 26 15:56:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 2025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 15:56:57.799803 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-5f967617-a356-4bcc-b068-d67b0524cdc4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:57.801262 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-5f967617-a356-4bcc-b068-d67b0524cdc4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:58.476805 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-5f967617-a356-4bcc-b068-d67b0524cdc4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:58.486637 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-5f967617-a356-4bcc-b068-d67b0524cdc4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1242 microversion: 2.1 time: 0.692372 Aug 26 15:56:58.489283 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 15/24] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:57 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1242 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:58.503290 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-9d0bb600-7334-4084-bfe1-18be384029e5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:58.503904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-9d0bb600-7334-4084-bfe1-18be384029e5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:58.510101 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9d0bb600-7334-4084-bfe1-18be384029e5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:58.516477 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9d0bb600-7334-4084-bfe1-18be384029e5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:58.519133 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9d0bb600-7334-4084-bfe1-18be384029e5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:58.522751 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9d0bb600-7334-4084-bfe1-18be384029e5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:58.522751 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9d0bb600-7334-4084-bfe1-18be384029e5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:58.522751 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9d0bb600-7334-4084-bfe1-18be384029e5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:58.993881 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-9d0bb600-7334-4084-bfe1-18be384029e5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:59.041137 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-9d0bb600-7334-4084-bfe1-18be384029e5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1274 microversion: 2.1 time: 0.547961 Aug 26 15:56:59.054586 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 16/25] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:58 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1274 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:59.062325 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a979a6cc-f1b8-4156-a0f6-a32ea6fc9224 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:59.063644 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a979a6cc-f1b8-4156-a0f6-a32ea6fc9224 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:59.072421 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a979a6cc-f1b8-4156-a0f6-a32ea6fc9224 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:59.074299 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a979a6cc-f1b8-4156-a0f6-a32ea6fc9224 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:59.075279 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a979a6cc-f1b8-4156-a0f6-a32ea6fc9224 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:59.077219 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a979a6cc-f1b8-4156-a0f6-a32ea6fc9224 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:59.078668 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a979a6cc-f1b8-4156-a0f6-a32ea6fc9224 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:59.080325 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a979a6cc-f1b8-4156-a0f6-a32ea6fc9224 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:59.205426 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a979a6cc-f1b8-4156-a0f6-a32ea6fc9224 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:59.217152 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a979a6cc-f1b8-4156-a0f6-a32ea6fc9224 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1267 microversion: 2.1 time: 0.159843 Aug 26 15:56:59.218838 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 17/26] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:59 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:56:59.523985 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-31ebb040-00cf-4198-af2f-3c19f639d370 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:56:59.526730 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-31ebb040-00cf-4198-af2f-3c19f639d370 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:56:59.680149 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-4ed88385-15fe-4867-9ad1-e96d090e995b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Flavor limits 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:56:59.680902 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-4ed88385-15fe-4867-9ad1-e96d090e995b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Image limits 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:56:59.681661 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-4ed88385-15fe-4867-9ad1-e96d090e995b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Flavor pref 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:56:59.682216 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-4ed88385-15fe-4867-9ad1-e96d090e995b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Image pref 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:56:59.693302 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-4ed88385-15fe-4867-9ad1-e96d090e995b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:56:59.718287 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-31ebb040-00cf-4198-af2f-3c19f639d370 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:56:59.728902 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ed88385-15fe-4867-9ad1-e96d090e995b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:59.729267 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-31ebb040-00cf-4198-af2f-3c19f639d370 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1242 microversion: 2.1 time: 0.220926 Aug 26 15:56:59.730204 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 18/27] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:56:59 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1242 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:56:59.730691 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ed88385-15fe-4867-9ad1-e96d090e995b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:59.732608 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ed88385-15fe-4867-9ad1-e96d090e995b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:59.734907 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ed88385-15fe-4867-9ad1-e96d090e995b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:56:59.736570 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ed88385-15fe-4867-9ad1-e96d090e995b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:56:59.737025 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ed88385-15fe-4867-9ad1-e96d090e995b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:56:59.825526 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-4ed88385-15fe-4867-9ad1-e96d090e995b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Getting quotas for project 8c69c9fb12124d72954b8ab7ad024175. Resources: {'instances', 'ram', 'cores'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:56:59.837502 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-4ed88385-15fe-4867-9ad1-e96d090e995b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Getting quotas for user 7069a9b54a3245b3ab9671730344e6d3 and project 8c69c9fb12124d72954b8ab7ad024175. Resources: {'instances', 'ram', 'cores'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:56:59.865516 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-4ed88385-15fe-4867-9ad1-e96d090e995b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Going to run 1 instances... {{(pid=128304) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:56:59.868305 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-4ed88385-15fe-4867-9ad1-e96d090e995b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bcbdbb0c-7335-4427-a636-e2dc730274b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:57:00.065643 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-34a7d216-cc9d-4beb-bfff-6a203339081c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:00.066590 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-34a7d216-cc9d-4beb-bfff-6a203339081c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:00.073148 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-34a7d216-cc9d-4beb-bfff-6a203339081c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:00.077862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-34a7d216-cc9d-4beb-bfff-6a203339081c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:00.083031 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-34a7d216-cc9d-4beb-bfff-6a203339081c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:00.090950 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-34a7d216-cc9d-4beb-bfff-6a203339081c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:00.090950 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-34a7d216-cc9d-4beb-bfff-6a203339081c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:00.090950 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-34a7d216-cc9d-4beb-bfff-6a203339081c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:00.107868 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-4ed88385-15fe-4867-9ad1-e96d090e995b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.750293 Aug 26 15:57:00.110911 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 10/28] 10.222.0.94 () {60 vars in 1147 bytes} [Fri Aug 26 15:56:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 2754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 15:57:00.130537 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-61839511-a2a4-4af3-8ed4-f9f371ed4496 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:00.132996 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-61839511-a2a4-4af3-8ed4-f9f371ed4496 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:00.197842 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-34a7d216-cc9d-4beb-bfff-6a203339081c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:00.213925 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-34a7d216-cc9d-4beb-bfff-6a203339081c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1274 microversion: 2.1 time: 0.152277 Aug 26 15:57:00.215682 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 19/29] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:00 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1274 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:57:00.247691 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a281b367-7a07-47d8-b057-a51e814099ba tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:00.249300 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a281b367-7a07-47d8-b057-a51e814099ba tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:00.262643 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a281b367-7a07-47d8-b057-a51e814099ba tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:00.264777 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a281b367-7a07-47d8-b057-a51e814099ba tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:00.267081 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a281b367-7a07-47d8-b057-a51e814099ba tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:00.267753 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a281b367-7a07-47d8-b057-a51e814099ba tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:00.269566 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a281b367-7a07-47d8-b057-a51e814099ba tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:00.270804 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a281b367-7a07-47d8-b057-a51e814099ba tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:00.543273 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a281b367-7a07-47d8-b057-a51e814099ba tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:00.555736 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a281b367-7a07-47d8-b057-a51e814099ba tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1267 microversion: 2.1 time: 0.313749 Aug 26 15:57:00.558241 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 20/30] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:00 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1267 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:00.648482 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-61839511-a2a4-4af3-8ed4-f9f371ed4496 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:00.660499 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-61839511-a2a4-4af3-8ed4-f9f371ed4496 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1237 microversion: 2.1 time: 0.543960 Aug 26 15:57:00.663056 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 11/31] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:00 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1237 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:00.750896 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-8dfec1ce-5a2a-4c77-b72c-f4c95856eaa0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:00.751600 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-8dfec1ce-5a2a-4c77-b72c-f4c95856eaa0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:00.776310 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8dfec1ce-5a2a-4c77-b72c-f4c95856eaa0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:00.778336 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8dfec1ce-5a2a-4c77-b72c-f4c95856eaa0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:00.781604 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8dfec1ce-5a2a-4c77-b72c-f4c95856eaa0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:00.784547 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8dfec1ce-5a2a-4c77-b72c-f4c95856eaa0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:00.787674 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8dfec1ce-5a2a-4c77-b72c-f4c95856eaa0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:00.790819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8dfec1ce-5a2a-4c77-b72c-f4c95856eaa0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:00.985731 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-8dfec1ce-5a2a-4c77-b72c-f4c95856eaa0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:00.996384 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-8dfec1ce-5a2a-4c77-b72c-f4c95856eaa0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1294 microversion: 2.1 time: 0.250037 Aug 26 15:57:00.998122 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 21/32] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:00 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1294 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:00.999855 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-b7fe9b8b-1b2f-491d-b4de-052876bcafe8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1088837922", "imageRef": "bcbdbb0c-7335-4427-a636-e2dc730274b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "14fbb9b0-48c1-40b4-822d-b21197d95a3b"}], "security_groups": [{"name": "tempest-securitygroup--2082871707"}], "key_name": "tempest-keypair-1446175540", "user_data": "}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:57:01.243761 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-991dba60-ec1a-438d-8f30-c27127c4c145 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:01.244657 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-991dba60-ec1a-438d-8f30-c27127c4c145 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:01.262007 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-991dba60-ec1a-438d-8f30-c27127c4c145 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:01.265393 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-991dba60-ec1a-438d-8f30-c27127c4c145 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:01.265977 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-991dba60-ec1a-438d-8f30-c27127c4c145 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:01.270775 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-991dba60-ec1a-438d-8f30-c27127c4c145 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:01.271363 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-991dba60-ec1a-438d-8f30-c27127c4c145 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:01.274677 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-991dba60-ec1a-438d-8f30-c27127c4c145 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:01.422054 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-991dba60-ec1a-438d-8f30-c27127c4c145 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:01.430643 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-991dba60-ec1a-438d-8f30-c27127c4c145 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1280 microversion: 2.1 time: 0.192738 Aug 26 15:57:01.442085 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 22/33] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:01 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1280 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:01.469207 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.network.neutron [None req-b7fe9b8b-1b2f-491d-b4de-052876bcafe8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] validate_networks() for [('14fbb9b0-48c1-40b4-822d-b21197d95a3b', None, None, None, None, None)] {{(pid=128304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:57:01.580969 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-9a5c6f6b-3034-4dbc-945e-3a63ead720ea tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:01.582069 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-9a5c6f6b-3034-4dbc-945e-3a63ead720ea tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:01.595103 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9a5c6f6b-3034-4dbc-945e-3a63ead720ea tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:01.595818 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9a5c6f6b-3034-4dbc-945e-3a63ead720ea tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:01.596182 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9a5c6f6b-3034-4dbc-945e-3a63ead720ea tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:01.600551 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9a5c6f6b-3034-4dbc-945e-3a63ead720ea tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:01.601070 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9a5c6f6b-3034-4dbc-945e-3a63ead720ea tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:01.601517 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9a5c6f6b-3034-4dbc-945e-3a63ead720ea tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:01.938422 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-9a5c6f6b-3034-4dbc-945e-3a63ead720ea tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:01.948268 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-9a5c6f6b-3034-4dbc-945e-3a63ead720ea tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1273 microversion: 2.1 time: 0.374325 Aug 26 15:57:01.948856 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 23/34] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:01 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1273 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:57:01.962271 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-8215a2db-5f3f-443b-925f-91e5a2643fb7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:01.963109 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-8215a2db-5f3f-443b-925f-91e5a2643fb7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:02.143157 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-8215a2db-5f3f-443b-925f-91e5a2643fb7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:02.153683 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-8215a2db-5f3f-443b-925f-91e5a2643fb7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1237 microversion: 2.1 time: 0.193009 Aug 26 15:57:02.155758 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 24/35] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:01 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1237 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:02.168235 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-4f44bca1-6521-45d9-b1c7-8446abf8d208 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:02.169032 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-4f44bca1-6521-45d9-b1c7-8446abf8d208 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:02.188453 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4f44bca1-6521-45d9-b1c7-8446abf8d208 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:02.190743 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4f44bca1-6521-45d9-b1c7-8446abf8d208 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:02.191539 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4f44bca1-6521-45d9-b1c7-8446abf8d208 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:02.192566 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4f44bca1-6521-45d9-b1c7-8446abf8d208 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:02.193185 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4f44bca1-6521-45d9-b1c7-8446abf8d208 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:02.195926 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4f44bca1-6521-45d9-b1c7-8446abf8d208 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:02.553120 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-4f44bca1-6521-45d9-b1c7-8446abf8d208 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:02.592122 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-4f44bca1-6521-45d9-b1c7-8446abf8d208 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1302 microversion: 2.1 time: 0.406066 Aug 26 15:57:02.592122 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 25/36] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:02 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1302 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:02.592122 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-465f5184-c5f7-404f-8dbb-7c0a80b4c9bc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:02.592122 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-465f5184-c5f7-404f-8dbb-7c0a80b4c9bc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:02.596391 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-465f5184-c5f7-404f-8dbb-7c0a80b4c9bc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:02.604753 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-465f5184-c5f7-404f-8dbb-7c0a80b4c9bc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:02.610052 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-465f5184-c5f7-404f-8dbb-7c0a80b4c9bc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:02.611149 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-465f5184-c5f7-404f-8dbb-7c0a80b4c9bc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:02.611806 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-465f5184-c5f7-404f-8dbb-7c0a80b4c9bc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:02.612424 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-465f5184-c5f7-404f-8dbb-7c0a80b4c9bc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:03.277871 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-465f5184-c5f7-404f-8dbb-7c0a80b4c9bc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:03.286733 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-465f5184-c5f7-404f-8dbb-7c0a80b4c9bc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1280 microversion: 2.1 time: 0.714586 Aug 26 15:57:03.307896 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 26/37] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:02 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1280 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:03.318720 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-d146ed21-be46-47bd-8f5b-3fb6e225f3e4 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:03.319376 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-d146ed21-be46-47bd-8f5b-3fb6e225f3e4 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:03.339050 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d146ed21-be46-47bd-8f5b-3fb6e225f3e4 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:03.339832 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d146ed21-be46-47bd-8f5b-3fb6e225f3e4 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:03.340616 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d146ed21-be46-47bd-8f5b-3fb6e225f3e4 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:03.342588 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d146ed21-be46-47bd-8f5b-3fb6e225f3e4 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:03.343255 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d146ed21-be46-47bd-8f5b-3fb6e225f3e4 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:03.343854 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d146ed21-be46-47bd-8f5b-3fb6e225f3e4 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:03.552706 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d146ed21-be46-47bd-8f5b-3fb6e225f3e4 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:03.561994 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-d146ed21-be46-47bd-8f5b-3fb6e225f3e4 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1273 microversion: 2.1 time: 0.252511 Aug 26 15:57:03.569542 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 27/38] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:03 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1273 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:03.588606 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-3cca315d-8fa5-440b-a1ba-03cb24680a91 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:03.589277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-3cca315d-8fa5-440b-a1ba-03cb24680a91 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:03.617046 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3cca315d-8fa5-440b-a1ba-03cb24680a91 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:03.617705 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3cca315d-8fa5-440b-a1ba-03cb24680a91 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:03.617955 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3cca315d-8fa5-440b-a1ba-03cb24680a91 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:03.618659 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3cca315d-8fa5-440b-a1ba-03cb24680a91 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:03.626718 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3cca315d-8fa5-440b-a1ba-03cb24680a91 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:03.627205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3cca315d-8fa5-440b-a1ba-03cb24680a91 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:04.005640 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-3cca315d-8fa5-440b-a1ba-03cb24680a91 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:04.024061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-3cca315d-8fa5-440b-a1ba-03cb24680a91 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1289 microversion: 2.1 time: 0.455906 Aug 26 15:57:04.026911 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 28/39] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:03 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1289 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:04.051270 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-729507d9-f184-4cf2-888e-dc3578f8680b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:04.052688 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-729507d9-f184-4cf2-888e-dc3578f8680b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:04.094130 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-729507d9-f184-4cf2-888e-dc3578f8680b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:04.094984 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-729507d9-f184-4cf2-888e-dc3578f8680b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:04.097461 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-729507d9-f184-4cf2-888e-dc3578f8680b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:04.098537 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-729507d9-f184-4cf2-888e-dc3578f8680b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:04.100281 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-729507d9-f184-4cf2-888e-dc3578f8680b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:04.102094 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-729507d9-f184-4cf2-888e-dc3578f8680b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:04.182850 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-b7fe9b8b-1b2f-491d-b4de-052876bcafe8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Flavor limits 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:57:04.183389 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-b7fe9b8b-1b2f-491d-b4de-052876bcafe8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Image limits 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:57:04.183807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-b7fe9b8b-1b2f-491d-b4de-052876bcafe8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Flavor pref 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:57:04.190273 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-b7fe9b8b-1b2f-491d-b4de-052876bcafe8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Image pref 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:57:04.213428 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-b7fe9b8b-1b2f-491d-b4de-052876bcafe8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:57:04.247545 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b7fe9b8b-1b2f-491d-b4de-052876bcafe8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:04.247545 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b7fe9b8b-1b2f-491d-b4de-052876bcafe8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:04.247863 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b7fe9b8b-1b2f-491d-b4de-052876bcafe8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:04.248671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b7fe9b8b-1b2f-491d-b4de-052876bcafe8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:04.254185 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b7fe9b8b-1b2f-491d-b4de-052876bcafe8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:04.260525 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b7fe9b8b-1b2f-491d-b4de-052876bcafe8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:04.307741 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-b7fe9b8b-1b2f-491d-b4de-052876bcafe8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Getting quotas for project e8bfb4199b0d4a57933fe1b685aa01cd. Resources: {'instances', 'ram', 'cores'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:57:04.313016 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:57:04.320731 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-b7fe9b8b-1b2f-491d-b4de-052876bcafe8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Getting quotas for user 228837054cd648acb0df93dd423e1d83 and project e8bfb4199b0d4a57933fe1b685aa01cd. Resources: {'instances', 'ram', 'cores'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:57:04.352244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-b7fe9b8b-1b2f-491d-b4de-052876bcafe8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Going to run 1 instances... {{(pid=128304) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:57:04.363956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-b7fe9b8b-1b2f-491d-b4de-052876bcafe8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bcbdbb0c-7335-4427-a636-e2dc730274b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:57:04.434033 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-729507d9-f184-4cf2-888e-dc3578f8680b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:04.449762 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-729507d9-f184-4cf2-888e-dc3578f8680b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1300 microversion: 2.1 time: 0.415712 Aug 26 15:57:04.451222 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 29/40] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:04 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1300 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:04.474460 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-7701ee4d-f192-46ac-a1ec-57e9b43d71aa tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:04.476418 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-7701ee4d-f192-46ac-a1ec-57e9b43d71aa tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:04.504639 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7701ee4d-f192-46ac-a1ec-57e9b43d71aa tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:04.505656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7701ee4d-f192-46ac-a1ec-57e9b43d71aa tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:04.507478 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7701ee4d-f192-46ac-a1ec-57e9b43d71aa tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:04.512221 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7701ee4d-f192-46ac-a1ec-57e9b43d71aa tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:04.514737 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7701ee4d-f192-46ac-a1ec-57e9b43d71aa tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:04.514737 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7701ee4d-f192-46ac-a1ec-57e9b43d71aa tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:04.688814 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-b7fe9b8b-1b2f-491d-b4de-052876bcafe8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.713564 Aug 26 15:57:04.718659 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 12/41] 10.222.0.94 () {62 vars in 1188 bytes} [Fri Aug 26 15:57:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 3745 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 26 15:57:04.764997 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-7701ee4d-f192-46ac-a1ec-57e9b43d71aa tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:04.765949 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-30705bb3-4508-4a10-866e-01bd3aeac474 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:04.766184 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-7701ee4d-f192-46ac-a1ec-57e9b43d71aa tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1280 microversion: 2.1 time: 0.296175 Aug 26 15:57:04.766184 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 30/42] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:04 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1280 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:04.766184 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-d6458f94-6594-4c35-8638-db45eaeada78 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:04.766184 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-d6458f94-6594-4c35-8638-db45eaeada78 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:04.766476 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-30705bb3-4508-4a10-866e-01bd3aeac474 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:04.770002 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-30705bb3-4508-4a10-866e-01bd3aeac474 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:04.770002 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-30705bb3-4508-4a10-866e-01bd3aeac474 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:04.773106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-30705bb3-4508-4a10-866e-01bd3aeac474 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:04.773835 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-30705bb3-4508-4a10-866e-01bd3aeac474 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:04.774301 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-30705bb3-4508-4a10-866e-01bd3aeac474 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:04.778132 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-30705bb3-4508-4a10-866e-01bd3aeac474 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:04.994496 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d6458f94-6594-4c35-8638-db45eaeada78 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:05.014511 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d6458f94-6594-4c35-8638-db45eaeada78 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:05.019272 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d6458f94-6594-4c35-8638-db45eaeada78 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:05.021294 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-d6458f94-6594-4c35-8638-db45eaeada78 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1282 microversion: 2.20 time: 0.268218 Aug 26 15:57:05.021863 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 31/43] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:04 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1282 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:05.052869 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a43175f2-3b2f-4b98-a164-5b4707a91ee1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:05.053833 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a43175f2-3b2f-4b98-a164-5b4707a91ee1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:05.064863 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a43175f2-3b2f-4b98-a164-5b4707a91ee1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:05.067514 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a43175f2-3b2f-4b98-a164-5b4707a91ee1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:05.068256 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a43175f2-3b2f-4b98-a164-5b4707a91ee1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:05.071140 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a43175f2-3b2f-4b98-a164-5b4707a91ee1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:05.071787 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a43175f2-3b2f-4b98-a164-5b4707a91ee1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:05.073246 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a43175f2-3b2f-4b98-a164-5b4707a91ee1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:05.474933 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a43175f2-3b2f-4b98-a164-5b4707a91ee1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:05.495354 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a43175f2-3b2f-4b98-a164-5b4707a91ee1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1297 microversion: 2.1 time: 0.440286 Aug 26 15:57:05.496650 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 32/44] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:05 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1297 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:05.516535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-702f6b4a-ee58-4b42-8d09-5e7fb50200ab tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:05.521670 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-702f6b4a-ee58-4b42-8d09-5e7fb50200ab tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:05.539226 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:57:05.553365 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-702f6b4a-ee58-4b42-8d09-5e7fb50200ab tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:05.556512 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-702f6b4a-ee58-4b42-8d09-5e7fb50200ab tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:05.558275 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-702f6b4a-ee58-4b42-8d09-5e7fb50200ab tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:05.562474 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-702f6b4a-ee58-4b42-8d09-5e7fb50200ab tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:05.563622 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-702f6b4a-ee58-4b42-8d09-5e7fb50200ab tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:05.565368 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-702f6b4a-ee58-4b42-8d09-5e7fb50200ab tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:05.890892 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-30705bb3-4508-4a10-866e-01bd3aeac474 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:05.958747 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-30705bb3-4508-4a10-866e-01bd3aeac474 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1315 microversion: 2.1 time: 1.232981 Aug 26 15:57:05.961952 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 13/45] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:04 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1315 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:05.995371 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-258253c6-7ead-4722-82a1-1ce3333337cf tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:05.998551 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-258253c6-7ead-4722-82a1-1ce3333337cf tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:06.006246 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-258253c6-7ead-4722-82a1-1ce3333337cf tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:06.009680 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-258253c6-7ead-4722-82a1-1ce3333337cf tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:06.010386 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-258253c6-7ead-4722-82a1-1ce3333337cf tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:06.011303 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-258253c6-7ead-4722-82a1-1ce3333337cf tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:06.011909 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-258253c6-7ead-4722-82a1-1ce3333337cf tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:06.012482 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-258253c6-7ead-4722-82a1-1ce3333337cf tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:06.566882 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-702f6b4a-ee58-4b42-8d09-5e7fb50200ab tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:06.589030 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-702f6b4a-ee58-4b42-8d09-5e7fb50200ab tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1367 microversion: 2.1 time: 1.087005 Aug 26 15:57:06.600575 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 33/46] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:05 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1367 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:06.619491 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-004743fa-436a-4f91-bc64-6fe011e6889b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:06.632008 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-004743fa-436a-4f91-bc64-6fe011e6889b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:06.653901 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-004743fa-436a-4f91-bc64-6fe011e6889b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:06.654497 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-004743fa-436a-4f91-bc64-6fe011e6889b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:06.658164 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-004743fa-436a-4f91-bc64-6fe011e6889b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:06.659488 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-004743fa-436a-4f91-bc64-6fe011e6889b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:06.661367 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-004743fa-436a-4f91-bc64-6fe011e6889b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:06.661820 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-004743fa-436a-4f91-bc64-6fe011e6889b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:07.119486 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-004743fa-436a-4f91-bc64-6fe011e6889b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:07.122878 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=100 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:57:07.148205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-004743fa-436a-4f91-bc64-6fe011e6889b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:07.156795 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-004743fa-436a-4f91-bc64-6fe011e6889b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:07.167210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-004743fa-436a-4f91-bc64-6fe011e6889b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1286 microversion: 2.20 time: 0.551877 Aug 26 15:57:07.167210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 34/47] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:06 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1286 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:07.167210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-5e2b379a-4019-48a1-badc-18f5d3d6770a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:07.167210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-5e2b379a-4019-48a1-badc-18f5d3d6770a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:07.189204 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5e2b379a-4019-48a1-badc-18f5d3d6770a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:07.195132 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5e2b379a-4019-48a1-badc-18f5d3d6770a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:07.195716 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5e2b379a-4019-48a1-badc-18f5d3d6770a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:07.196506 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5e2b379a-4019-48a1-badc-18f5d3d6770a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:07.197061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5e2b379a-4019-48a1-badc-18f5d3d6770a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:07.215157 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5e2b379a-4019-48a1-badc-18f5d3d6770a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:07.260159 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-258253c6-7ead-4722-82a1-1ce3333337cf tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:07.274456 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-258253c6-7ead-4722-82a1-1ce3333337cf tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1322 microversion: 2.1 time: 1.309823 Aug 26 15:57:07.278057 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 14/48] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:05 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1322 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:07.291570 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-9e21cc02-5f2b-4a15-952d-97e716b2b4a6 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:07.298501 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-9e21cc02-5f2b-4a15-952d-97e716b2b4a6 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:07.305944 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9e21cc02-5f2b-4a15-952d-97e716b2b4a6 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:07.306830 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9e21cc02-5f2b-4a15-952d-97e716b2b4a6 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:07.307527 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9e21cc02-5f2b-4a15-952d-97e716b2b4a6 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:07.308587 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9e21cc02-5f2b-4a15-952d-97e716b2b4a6 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:07.309726 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9e21cc02-5f2b-4a15-952d-97e716b2b4a6 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:07.310398 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9e21cc02-5f2b-4a15-952d-97e716b2b4a6 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:07.365861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell0:SELECT=4 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:57:07.662861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-5e2b379a-4019-48a1-badc-18f5d3d6770a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:07.697704 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-5e2b379a-4019-48a1-badc-18f5d3d6770a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1295 microversion: 2.1 time: 0.537942 Aug 26 15:57:07.699783 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 35/49] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:07 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1295 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:07.709285 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-2b650a61-1098-4676-baee-efd0f5dfd3d1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:07.712411 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-2b650a61-1098-4676-baee-efd0f5dfd3d1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:07.720485 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2b650a61-1098-4676-baee-efd0f5dfd3d1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:07.721258 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2b650a61-1098-4676-baee-efd0f5dfd3d1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:07.721898 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2b650a61-1098-4676-baee-efd0f5dfd3d1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:07.723086 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2b650a61-1098-4676-baee-efd0f5dfd3d1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:07.723757 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2b650a61-1098-4676-baee-efd0f5dfd3d1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:07.724423 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2b650a61-1098-4676-baee-efd0f5dfd3d1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:08.097749 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-9e21cc02-5f2b-4a15-952d-97e716b2b4a6 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:08.112070 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-9e21cc02-5f2b-4a15-952d-97e716b2b4a6 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1315 microversion: 2.1 time: 0.829844 Aug 26 15:57:08.112070 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 15/50] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:07 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1315 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:08.184565 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-3f6c44d9-e01b-470d-8903-daff3cfa119f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:08.193731 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-3f6c44d9-e01b-470d-8903-daff3cfa119f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:08.209323 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3f6c44d9-e01b-470d-8903-daff3cfa119f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:08.220742 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3f6c44d9-e01b-470d-8903-daff3cfa119f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:08.223056 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3f6c44d9-e01b-470d-8903-daff3cfa119f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:08.223986 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3f6c44d9-e01b-470d-8903-daff3cfa119f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:08.224810 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3f6c44d9-e01b-470d-8903-daff3cfa119f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:08.226893 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3f6c44d9-e01b-470d-8903-daff3cfa119f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:08.281483 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-2b650a61-1098-4676-baee-efd0f5dfd3d1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:08.297447 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-2b650a61-1098-4676-baee-efd0f5dfd3d1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1367 microversion: 2.1 time: 0.594294 Aug 26 15:57:08.301370 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 36/51] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:07 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1367 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:08.313561 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-424cc201-bd4a-44e5-8da1-cb2b8c7e5690 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:08.316221 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-424cc201-bd4a-44e5-8da1-cb2b8c7e5690 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:08.331414 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-424cc201-bd4a-44e5-8da1-cb2b8c7e5690 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:08.332315 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-424cc201-bd4a-44e5-8da1-cb2b8c7e5690 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:08.333028 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-424cc201-bd4a-44e5-8da1-cb2b8c7e5690 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:08.337977 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-424cc201-bd4a-44e5-8da1-cb2b8c7e5690 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:08.338841 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-424cc201-bd4a-44e5-8da1-cb2b8c7e5690 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:08.340305 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-424cc201-bd4a-44e5-8da1-cb2b8c7e5690 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:08.588510 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-3f6c44d9-e01b-470d-8903-daff3cfa119f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:08.597972 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-3f6c44d9-e01b-470d-8903-daff3cfa119f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:08.599457 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-3f6c44d9-e01b-470d-8903-daff3cfa119f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:08.609602 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-3f6c44d9-e01b-470d-8903-daff3cfa119f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1334 microversion: 2.20 time: 0.428722 Aug 26 15:57:08.610246 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 16/52] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:08 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1334 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:08.725180 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-e9e4d9d0-d0e4-4ebe-ba18-fc309473639e tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:08.725609 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-e9e4d9d0-d0e4-4ebe-ba18-fc309473639e tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:08.748402 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e9e4d9d0-d0e4-4ebe-ba18-fc309473639e tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:08.751996 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e9e4d9d0-d0e4-4ebe-ba18-fc309473639e tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:08.752672 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e9e4d9d0-d0e4-4ebe-ba18-fc309473639e tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:08.755422 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e9e4d9d0-d0e4-4ebe-ba18-fc309473639e tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:08.756122 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e9e4d9d0-d0e4-4ebe-ba18-fc309473639e tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:08.756722 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e9e4d9d0-d0e4-4ebe-ba18-fc309473639e tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:09.020064 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e9e4d9d0-d0e4-4ebe-ba18-fc309473639e tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:09.030863 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-e9e4d9d0-d0e4-4ebe-ba18-fc309473639e tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1295 microversion: 2.1 time: 0.310138 Aug 26 15:57:09.038042 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 17/53] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:08 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1295 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:09.042327 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-424cc201-bd4a-44e5-8da1-cb2b8c7e5690 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:09.052252 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-424cc201-bd4a-44e5-8da1-cb2b8c7e5690 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1322 microversion: 2.1 time: 0.748909 Aug 26 15:57:09.053185 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 37/54] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:08 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1322 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:09.137535 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-92c67199-e499-45db-940c-7c385c81994e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:09.138338 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-92c67199-e499-45db-940c-7c385c81994e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:09.155539 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-92c67199-e499-45db-940c-7c385c81994e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:09.155539 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-92c67199-e499-45db-940c-7c385c81994e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:09.155539 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-92c67199-e499-45db-940c-7c385c81994e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:09.155539 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-92c67199-e499-45db-940c-7c385c81994e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:09.155944 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-92c67199-e499-45db-940c-7c385c81994e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:09.155944 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-92c67199-e499-45db-940c-7c385c81994e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:09.322505 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-f34f4270-0b5d-46ff-a391-a5ca16075a60 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:09.323610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-f34f4270-0b5d-46ff-a391-a5ca16075a60 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:09.337683 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f34f4270-0b5d-46ff-a391-a5ca16075a60 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:09.338512 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f34f4270-0b5d-46ff-a391-a5ca16075a60 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:09.339220 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f34f4270-0b5d-46ff-a391-a5ca16075a60 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:09.340285 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f34f4270-0b5d-46ff-a391-a5ca16075a60 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:09.341134 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f34f4270-0b5d-46ff-a391-a5ca16075a60 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:09.342292 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f34f4270-0b5d-46ff-a391-a5ca16075a60 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:09.935356 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-92c67199-e499-45db-940c-7c385c81994e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:09.967646 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-92c67199-e499-45db-940c-7c385c81994e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1315 microversion: 2.1 time: 0.834551 Aug 26 15:57:09.974382 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 18/55] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:09 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1315 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:09.990087 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-9cb40b87-c7a4-42a8-ad59-777fde6db1ff tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:09.991190 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-9cb40b87-c7a4-42a8-ad59-777fde6db1ff tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:10.034619 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9cb40b87-c7a4-42a8-ad59-777fde6db1ff tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:10.038891 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9cb40b87-c7a4-42a8-ad59-777fde6db1ff tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:10.039791 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9cb40b87-c7a4-42a8-ad59-777fde6db1ff tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:10.040756 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9cb40b87-c7a4-42a8-ad59-777fde6db1ff tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:10.045875 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9cb40b87-c7a4-42a8-ad59-777fde6db1ff tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:10.048988 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9cb40b87-c7a4-42a8-ad59-777fde6db1ff tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:10.450944 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-9cb40b87-c7a4-42a8-ad59-777fde6db1ff tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:10.461948 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-9cb40b87-c7a4-42a8-ad59-777fde6db1ff tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:10.463780 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-9cb40b87-c7a4-42a8-ad59-777fde6db1ff tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:10.465098 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-9cb40b87-c7a4-42a8-ad59-777fde6db1ff tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1340 microversion: 2.20 time: 0.488696 Aug 26 15:57:10.466297 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 19/56] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:09 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1340 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:10.471980 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-1d15f2a3-8a67-4bff-9b2d-74012f24f197 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:10.472783 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-1d15f2a3-8a67-4bff-9b2d-74012f24f197 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:10.485163 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1d15f2a3-8a67-4bff-9b2d-74012f24f197 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:10.492978 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1d15f2a3-8a67-4bff-9b2d-74012f24f197 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:10.492978 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1d15f2a3-8a67-4bff-9b2d-74012f24f197 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:10.492978 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1d15f2a3-8a67-4bff-9b2d-74012f24f197 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:10.492978 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1d15f2a3-8a67-4bff-9b2d-74012f24f197 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:10.493932 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1d15f2a3-8a67-4bff-9b2d-74012f24f197 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:10.594628 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-f34f4270-0b5d-46ff-a391-a5ca16075a60 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:10.609539 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-f34f4270-0b5d-46ff-a391-a5ca16075a60 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1367 microversion: 2.1 time: 1.291029 Aug 26 15:57:10.629812 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 38/57] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:09 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1367 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:10.636821 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-ff504b59-f4d9-4857-bf61-d3908b10fae1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:10.637755 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-ff504b59-f4d9-4857-bf61-d3908b10fae1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:10.646073 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ff504b59-f4d9-4857-bf61-d3908b10fae1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:10.646832 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ff504b59-f4d9-4857-bf61-d3908b10fae1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:10.647979 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ff504b59-f4d9-4857-bf61-d3908b10fae1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:10.648958 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ff504b59-f4d9-4857-bf61-d3908b10fae1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:10.650855 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ff504b59-f4d9-4857-bf61-d3908b10fae1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:10.651602 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ff504b59-f4d9-4857-bf61-d3908b10fae1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:10.731149 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-1d15f2a3-8a67-4bff-9b2d-74012f24f197 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:10.742496 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-1d15f2a3-8a67-4bff-9b2d-74012f24f197 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1295 microversion: 2.1 time: 0.274848 Aug 26 15:57:10.746574 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 20/58] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:10 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1295 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:10.913267 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-af6297bb-226c-45c8-b4a6-445c9e917516 req-82e2d9e5-8a47-4660-99d6-6848f901d5b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c04e0499-9326-4fe8-8e28-80be6b0d7a14", "tag": "add18eae-55b9-4447-82eb-6d50b51bc859"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:57:10.983448 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-af6297bb-226c-45c8-b4a6-445c9e917516 req-82e2d9e5-8a47-4660-99d6-6848f901d5b4 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:10.984083 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-af6297bb-226c-45c8-b4a6-445c9e917516 req-82e2d9e5-8a47-4660-99d6-6848f901d5b4 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:10.984460 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-af6297bb-226c-45c8-b4a6-445c9e917516 req-82e2d9e5-8a47-4660-99d6-6848f901d5b4 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:11.028680 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-af6297bb-226c-45c8-b4a6-445c9e917516 req-82e2d9e5-8a47-4660-99d6-6848f901d5b4 service nova] Creating event network-changed:add18eae-55b9-4447-82eb-6d50b51bc859 for instance c04e0499-9326-4fe8-8e28-80be6b0d7a14 on hv-cinder-85144 Aug 26 15:57:11.029566 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-af6297bb-226c-45c8-b4a6-445c9e917516 req-82e2d9e5-8a47-4660-99d6-6848f901d5b4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128304) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 26 15:57:11.030254 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-af6297bb-226c-45c8-b4a6-445c9e917516 req-82e2d9e5-8a47-4660-99d6-6848f901d5b4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128304) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 26 15:57:11.031520 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8f5ecb15-b6b3-4324-9af4-63c2d9b6e887 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:11.032159 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8f5ecb15-b6b3-4324-9af4-63c2d9b6e887 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:11.032760 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8f5ecb15-b6b3-4324-9af4-63c2d9b6e887 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:11.033629 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8f5ecb15-b6b3-4324-9af4-63c2d9b6e887 None None] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:11.034439 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8f5ecb15-b6b3-4324-9af4-63c2d9b6e887 None None] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:11.035415 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8f5ecb15-b6b3-4324-9af4-63c2d9b6e887 None None] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:11.047524 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.compute.rpcapi [None req-8f5ecb15-b6b3-4324-9af4-63c2d9b6e887 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 26 15:57:11.048654 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8f5ecb15-b6b3-4324-9af4-63c2d9b6e887 None None] Releasing lock "compute-rpcapi-router" {{(pid=128304) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 26 15:57:11.100384 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-8f5ecb15-b6b3-4324-9af4-63c2d9b6e887 None None] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.349554 Aug 26 15:57:11.102623 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 21/59] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 15:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:57:11.345874 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-ff504b59-f4d9-4857-bf61-d3908b10fae1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:11.359317 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-ff504b59-f4d9-4857-bf61-d3908b10fae1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1322 microversion: 2.1 time: 0.726907 Aug 26 15:57:11.378080 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 39/60] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:10 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1322 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:11.384854 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-0c2fcd2a-030e-4d8d-92f9-41ab00ec0a99 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:11.385815 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-0c2fcd2a-030e-4d8d-92f9-41ab00ec0a99 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:11.410911 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0c2fcd2a-030e-4d8d-92f9-41ab00ec0a99 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:11.413294 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0c2fcd2a-030e-4d8d-92f9-41ab00ec0a99 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:11.416025 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0c2fcd2a-030e-4d8d-92f9-41ab00ec0a99 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:11.417138 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0c2fcd2a-030e-4d8d-92f9-41ab00ec0a99 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:11.426810 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0c2fcd2a-030e-4d8d-92f9-41ab00ec0a99 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:11.427551 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0c2fcd2a-030e-4d8d-92f9-41ab00ec0a99 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:11.456318 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-38f44f66-b282-4878-a38a-6a750aa990cd req-e65fcf03-0d0e-4ec7-97c2-0a832dce9b1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4425d401-9f5d-4aa8-a568-35ee9cd768bf", "tag": "7e519cd9-1a52-4518-a7ed-6455ad985b10"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:57:11.490855 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-38f44f66-b282-4878-a38a-6a750aa990cd req-e65fcf03-0d0e-4ec7-97c2-0a832dce9b1a service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:11.497164 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-38f44f66-b282-4878-a38a-6a750aa990cd req-e65fcf03-0d0e-4ec7-97c2-0a832dce9b1a service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:11.498526 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-38f44f66-b282-4878-a38a-6a750aa990cd req-e65fcf03-0d0e-4ec7-97c2-0a832dce9b1a service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:11.536002 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-38f44f66-b282-4878-a38a-6a750aa990cd req-e65fcf03-0d0e-4ec7-97c2-0a832dce9b1a service nova] Creating event network-changed:7e519cd9-1a52-4518-a7ed-6455ad985b10 for instance 4425d401-9f5d-4aa8-a568-35ee9cd768bf on hv-cinder-85144 Aug 26 15:57:11.542407 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-38f44f66-b282-4878-a38a-6a750aa990cd req-e65fcf03-0d0e-4ec7-97c2-0a832dce9b1a service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.436733 Aug 26 15:57:11.543436 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 22/61] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 15:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:57:11.549942 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-3d928ea9-daa0-42ed-9178-0699f8bd73a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:11.558335 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-3d928ea9-daa0-42ed-9178-0699f8bd73a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:11.560094 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3d928ea9-daa0-42ed-9178-0699f8bd73a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:11.561531 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3d928ea9-daa0-42ed-9178-0699f8bd73a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:11.562318 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3d928ea9-daa0-42ed-9178-0699f8bd73a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:11.563402 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3d928ea9-daa0-42ed-9178-0699f8bd73a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:11.564017 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3d928ea9-daa0-42ed-9178-0699f8bd73a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:11.564593 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3d928ea9-daa0-42ed-9178-0699f8bd73a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:11.733447 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-3d928ea9-daa0-42ed-9178-0699f8bd73a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:11.755251 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-3d928ea9-daa0-42ed-9178-0699f8bd73a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:11.760616 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-3d928ea9-daa0-42ed-9178-0699f8bd73a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:11.765139 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-3d928ea9-daa0-42ed-9178-0699f8bd73a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1340 microversion: 2.20 time: 0.217740 Aug 26 15:57:11.765930 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 23/62] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:11 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1340 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:11.782817 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-28d2f5ea-25bd-48c0-930f-3507fdca0d56 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:11.783226 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-28d2f5ea-25bd-48c0-930f-3507fdca0d56 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:11.799417 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-28d2f5ea-25bd-48c0-930f-3507fdca0d56 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:11.799907 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-28d2f5ea-25bd-48c0-930f-3507fdca0d56 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:11.800361 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-28d2f5ea-25bd-48c0-930f-3507fdca0d56 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:11.801060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-28d2f5ea-25bd-48c0-930f-3507fdca0d56 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:11.801421 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-0c2fcd2a-030e-4d8d-92f9-41ab00ec0a99 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:11.801898 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-28d2f5ea-25bd-48c0-930f-3507fdca0d56 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:11.814200 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-0c2fcd2a-030e-4d8d-92f9-41ab00ec0a99 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1315 microversion: 2.1 time: 0.434581 Aug 26 15:57:11.818781 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-28d2f5ea-25bd-48c0-930f-3507fdca0d56 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:11.830775 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 40/63] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:11 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:11.839554 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-6fbf1b12-719f-4a2b-87d1-a8b56781b1d0 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:11.839554 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-6fbf1b12-719f-4a2b-87d1-a8b56781b1d0 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:11.847197 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6fbf1b12-719f-4a2b-87d1-a8b56781b1d0 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:11.847741 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6fbf1b12-719f-4a2b-87d1-a8b56781b1d0 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:11.848170 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6fbf1b12-719f-4a2b-87d1-a8b56781b1d0 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:11.848940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6fbf1b12-719f-4a2b-87d1-a8b56781b1d0 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:11.850581 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6fbf1b12-719f-4a2b-87d1-a8b56781b1d0 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:11.851244 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6fbf1b12-719f-4a2b-87d1-a8b56781b1d0 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:12.129708 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-6fbf1b12-719f-4a2b-87d1-a8b56781b1d0 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:12.132446 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-28d2f5ea-25bd-48c0-930f-3507fdca0d56 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:12.139620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-6fbf1b12-719f-4a2b-87d1-a8b56781b1d0 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1363 microversion: 2.1 time: 0.306361 Aug 26 15:57:12.140231 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-28d2f5ea-25bd-48c0-930f-3507fdca0d56 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1367 microversion: 2.1 time: 0.367098 Aug 26 15:57:12.140386 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 41/64] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:11 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1363 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:12.141320 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 24/65] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:11 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1367 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:12.384098 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-63ac8ad6-3831-4e7c-8d28-fc93144600b5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:12.384712 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-63ac8ad6-3831-4e7c-8d28-fc93144600b5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:12.394132 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63ac8ad6-3831-4e7c-8d28-fc93144600b5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:12.394629 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63ac8ad6-3831-4e7c-8d28-fc93144600b5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:12.395106 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63ac8ad6-3831-4e7c-8d28-fc93144600b5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:12.395847 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63ac8ad6-3831-4e7c-8d28-fc93144600b5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:12.396301 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63ac8ad6-3831-4e7c-8d28-fc93144600b5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:12.400868 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63ac8ad6-3831-4e7c-8d28-fc93144600b5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:12.555298 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-63ac8ad6-3831-4e7c-8d28-fc93144600b5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:12.563647 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-63ac8ad6-3831-4e7c-8d28-fc93144600b5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1322 microversion: 2.1 time: 0.183308 Aug 26 15:57:12.564251 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 42/66] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:12 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:12.788061 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-2481c7ea-bb08-425c-9218-42c62b3fb757 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:12.788678 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-2481c7ea-bb08-425c-9218-42c62b3fb757 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:12.794895 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2481c7ea-bb08-425c-9218-42c62b3fb757 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:12.795584 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2481c7ea-bb08-425c-9218-42c62b3fb757 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:12.796109 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2481c7ea-bb08-425c-9218-42c62b3fb757 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:12.803792 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2481c7ea-bb08-425c-9218-42c62b3fb757 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:12.803792 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2481c7ea-bb08-425c-9218-42c62b3fb757 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:12.803792 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2481c7ea-bb08-425c-9218-42c62b3fb757 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:12.839216 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-3988a373-978b-4ef6-9a89-47bfb3e9f84c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:12.839884 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-3988a373-978b-4ef6-9a89-47bfb3e9f84c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:12.847083 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3988a373-978b-4ef6-9a89-47bfb3e9f84c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:12.847807 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3988a373-978b-4ef6-9a89-47bfb3e9f84c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:12.848234 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3988a373-978b-4ef6-9a89-47bfb3e9f84c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:12.849117 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3988a373-978b-4ef6-9a89-47bfb3e9f84c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:12.849750 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3988a373-978b-4ef6-9a89-47bfb3e9f84c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:12.850402 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3988a373-978b-4ef6-9a89-47bfb3e9f84c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:12.984289 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-2481c7ea-bb08-425c-9218-42c62b3fb757 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:12.992707 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-2481c7ea-bb08-425c-9218-42c62b3fb757 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:12.994231 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-2481c7ea-bb08-425c-9218-42c62b3fb757 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:12.998569 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-2481c7ea-bb08-425c-9218-42c62b3fb757 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1408 microversion: 2.20 time: 0.211251 Aug 26 15:57:12.998569 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 25/67] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:12 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1408 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:13.011801 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-3988a373-978b-4ef6-9a89-47bfb3e9f84c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:13.020394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-3988a373-978b-4ef6-9a89-47bfb3e9f84c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1315 microversion: 2.1 time: 0.185301 Aug 26 15:57:13.020960 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 43/68] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:12 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:57:13.160214 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ad54aa9c-9491-4409-9e1f-6f6607f2988c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:13.160758 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-bbb4727e-f10c-4d88-ac70-4cb636f790c6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:13.160886 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ad54aa9c-9491-4409-9e1f-6f6607f2988c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:13.160996 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-bbb4727e-f10c-4d88-ac70-4cb636f790c6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:13.166755 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ad54aa9c-9491-4409-9e1f-6f6607f2988c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:13.166908 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bbb4727e-f10c-4d88-ac70-4cb636f790c6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:13.167272 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ad54aa9c-9491-4409-9e1f-6f6607f2988c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:13.167405 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bbb4727e-f10c-4d88-ac70-4cb636f790c6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:13.167712 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ad54aa9c-9491-4409-9e1f-6f6607f2988c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:13.167803 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bbb4727e-f10c-4d88-ac70-4cb636f790c6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:13.168398 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ad54aa9c-9491-4409-9e1f-6f6607f2988c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:13.168487 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bbb4727e-f10c-4d88-ac70-4cb636f790c6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:13.168847 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ad54aa9c-9491-4409-9e1f-6f6607f2988c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:13.168932 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bbb4727e-f10c-4d88-ac70-4cb636f790c6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:13.169266 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ad54aa9c-9491-4409-9e1f-6f6607f2988c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:13.169355 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bbb4727e-f10c-4d88-ac70-4cb636f790c6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:13.374448 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-ad54aa9c-9491-4409-9e1f-6f6607f2988c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:13.381044 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-bbb4727e-f10c-4d88-ac70-4cb636f790c6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:13.384850 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ad54aa9c-9491-4409-9e1f-6f6607f2988c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1367 microversion: 2.1 time: 0.228285 Aug 26 15:57:13.397576 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-bbb4727e-f10c-4d88-ac70-4cb636f790c6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1363 microversion: 2.1 time: 0.234360 Aug 26 15:57:13.397684 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 26/69] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:13 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:13.401808 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-1c92a7d3-bad7-4397-9397-620513506999 req-3eced14c-f9e1-48a2-8499-46e91fb15e13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6103553d-b9c7-4ab7-aef1-3fd676bb0a8a", "tag": "c3d450c2-3d49-40aa-b88c-475438ac1fcc"}, {"name": "network-changed", "server_uuid": "18a7ee09-cb33-4638-a620-e36bc333cec6", "tag": "56c21eb3-a5af-49a5-afc3-c79bf7878007"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:57:13.411160 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 44/70] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:13 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:57:13.417114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-1c92a7d3-bad7-4397-9397-620513506999 req-3eced14c-f9e1-48a2-8499-46e91fb15e13 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:13.417689 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-1c92a7d3-bad7-4397-9397-620513506999 req-3eced14c-f9e1-48a2-8499-46e91fb15e13 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:13.418126 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-1c92a7d3-bad7-4397-9397-620513506999 req-3eced14c-f9e1-48a2-8499-46e91fb15e13 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:13.431912 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-1c92a7d3-bad7-4397-9397-620513506999 req-3eced14c-f9e1-48a2-8499-46e91fb15e13 service nova] Creating event network-changed:c3d450c2-3d49-40aa-b88c-475438ac1fcc for instance 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a on hv-cinder-85144 Aug 26 15:57:13.432418 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-1c92a7d3-bad7-4397-9397-620513506999 req-3eced14c-f9e1-48a2-8499-46e91fb15e13 service nova] Creating event network-changed:56c21eb3-a5af-49a5-afc3-c79bf7878007 for instance 18a7ee09-cb33-4638-a620-e36bc333cec6 on hv-cinder-85144 Aug 26 15:57:13.443222 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-1c92a7d3-bad7-4397-9397-620513506999 req-3eced14c-f9e1-48a2-8499-46e91fb15e13 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.049373 Aug 26 15:57:13.444146 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 27/71] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 15:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:57:13.594449 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-ceba4d8b-cab0-46f8-b30a-c4b90e4181f3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:13.595581 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-ceba4d8b-cab0-46f8-b30a-c4b90e4181f3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:13.601768 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ceba4d8b-cab0-46f8-b30a-c4b90e4181f3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:13.607034 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ceba4d8b-cab0-46f8-b30a-c4b90e4181f3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:13.607034 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ceba4d8b-cab0-46f8-b30a-c4b90e4181f3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:13.607034 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ceba4d8b-cab0-46f8-b30a-c4b90e4181f3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:13.607034 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ceba4d8b-cab0-46f8-b30a-c4b90e4181f3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:13.607386 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ceba4d8b-cab0-46f8-b30a-c4b90e4181f3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:13.742531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-ceba4d8b-cab0-46f8-b30a-c4b90e4181f3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:13.751124 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-ceba4d8b-cab0-46f8-b30a-c4b90e4181f3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1322 microversion: 2.1 time: 0.168600 Aug 26 15:57:13.751566 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 45/72] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:13 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:14.019447 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-08eca7a1-2dc1-4d11-909e-cdeb168b2c96 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:14.020151 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-08eca7a1-2dc1-4d11-909e-cdeb168b2c96 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:14.026472 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-08eca7a1-2dc1-4d11-909e-cdeb168b2c96 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:14.026990 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-08eca7a1-2dc1-4d11-909e-cdeb168b2c96 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:14.033358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-08eca7a1-2dc1-4d11-909e-cdeb168b2c96 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:14.033358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-08eca7a1-2dc1-4d11-909e-cdeb168b2c96 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:14.033358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-08eca7a1-2dc1-4d11-909e-cdeb168b2c96 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:14.033358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-08eca7a1-2dc1-4d11-909e-cdeb168b2c96 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:14.033678 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=89 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:57:14.041669 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-7290e1df-6a81-46e5-b172-3374e949893d tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:14.042311 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-7290e1df-6a81-46e5-b172-3374e949893d tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:14.049169 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7290e1df-6a81-46e5-b172-3374e949893d tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:14.049653 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7290e1df-6a81-46e5-b172-3374e949893d tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:14.050152 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7290e1df-6a81-46e5-b172-3374e949893d tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:14.051530 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7290e1df-6a81-46e5-b172-3374e949893d tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:14.051530 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7290e1df-6a81-46e5-b172-3374e949893d tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:14.051807 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7290e1df-6a81-46e5-b172-3374e949893d tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:14.336438 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell0:SELECT=40 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:57:14.585448 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-7290e1df-6a81-46e5-b172-3374e949893d tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:14.597275 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-7290e1df-6a81-46e5-b172-3374e949893d tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1315 microversion: 2.1 time: 0.559386 Aug 26 15:57:14.597894 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 46/73] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:14 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1315 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:57:14.607933 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-bd16273b-826f-4b04-9a40-945be802792a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:14.611030 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-bd16273b-826f-4b04-9a40-945be802792a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:14.618632 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bd16273b-826f-4b04-9a40-945be802792a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:14.629265 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-08eca7a1-2dc1-4d11-909e-cdeb168b2c96 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:14.634687 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bd16273b-826f-4b04-9a40-945be802792a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:14.635629 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bd16273b-826f-4b04-9a40-945be802792a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:14.640705 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bd16273b-826f-4b04-9a40-945be802792a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:14.641441 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bd16273b-826f-4b04-9a40-945be802792a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:14.642052 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bd16273b-826f-4b04-9a40-945be802792a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:14.651878 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-08eca7a1-2dc1-4d11-909e-cdeb168b2c96 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:14.657233 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-08eca7a1-2dc1-4d11-909e-cdeb168b2c96 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:14.659629 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-08eca7a1-2dc1-4d11-909e-cdeb168b2c96 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1408 microversion: 2.20 time: 0.643893 Aug 26 15:57:14.674981 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 28/74] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:14 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1408 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:14.690788 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-8a8269f3-1344-4c34-8fbe-25b55fba1f09 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:14.691760 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-8a8269f3-1344-4c34-8fbe-25b55fba1f09 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:14.705796 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8a8269f3-1344-4c34-8fbe-25b55fba1f09 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:14.706594 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8a8269f3-1344-4c34-8fbe-25b55fba1f09 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:14.707224 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8a8269f3-1344-4c34-8fbe-25b55fba1f09 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:14.708119 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8a8269f3-1344-4c34-8fbe-25b55fba1f09 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:14.708770 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8a8269f3-1344-4c34-8fbe-25b55fba1f09 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:14.709497 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8a8269f3-1344-4c34-8fbe-25b55fba1f09 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:14.950046 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-bd16273b-826f-4b04-9a40-945be802792a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:14.960108 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-bd16273b-826f-4b04-9a40-945be802792a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1367 microversion: 2.1 time: 0.356694 Aug 26 15:57:14.980322 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 47/75] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:14 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1367 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:14.986292 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-0acc4650-d8e2-4822-b846-86c89a1fb4db tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:14.986907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-0acc4650-d8e2-4822-b846-86c89a1fb4db tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:14.994563 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0acc4650-d8e2-4822-b846-86c89a1fb4db tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:14.995088 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0acc4650-d8e2-4822-b846-86c89a1fb4db tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:14.995570 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0acc4650-d8e2-4822-b846-86c89a1fb4db tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:14.996252 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0acc4650-d8e2-4822-b846-86c89a1fb4db tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:14.996668 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0acc4650-d8e2-4822-b846-86c89a1fb4db tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:14.997088 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0acc4650-d8e2-4822-b846-86c89a1fb4db tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:15.015297 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell0:SELECT=28 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:57:15.045225 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-8a8269f3-1344-4c34-8fbe-25b55fba1f09 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:15.060393 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-8a8269f3-1344-4c34-8fbe-25b55fba1f09 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1363 microversion: 2.1 time: 0.383803 Aug 26 15:57:15.061977 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 29/76] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:14 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1363 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:15.178749 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-0acc4650-d8e2-4822-b846-86c89a1fb4db tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:15.189106 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-0acc4650-d8e2-4822-b846-86c89a1fb4db tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1322 microversion: 2.1 time: 0.205548 Aug 26 15:57:15.189717 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 48/77] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:14 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:15.628632 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-a4407db5-3f21-45e4-bd99-4067e041270c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:15.630329 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-a4407db5-3f21-45e4-bd99-4067e041270c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:15.639601 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a4407db5-3f21-45e4-bd99-4067e041270c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:15.640416 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a4407db5-3f21-45e4-bd99-4067e041270c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:15.641041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a4407db5-3f21-45e4-bd99-4067e041270c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:15.642133 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a4407db5-3f21-45e4-bd99-4067e041270c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:15.643445 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a4407db5-3f21-45e4-bd99-4067e041270c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:15.644055 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a4407db5-3f21-45e4-bd99-4067e041270c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:15.704424 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-00420e6a-ca00-4442-bc9d-03c768944d0d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:15.704424 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-00420e6a-ca00-4442-bc9d-03c768944d0d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:15.705554 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-00420e6a-ca00-4442-bc9d-03c768944d0d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:15.706266 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-00420e6a-ca00-4442-bc9d-03c768944d0d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:15.706915 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-00420e6a-ca00-4442-bc9d-03c768944d0d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:15.707863 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-00420e6a-ca00-4442-bc9d-03c768944d0d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:15.708679 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-00420e6a-ca00-4442-bc9d-03c768944d0d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:15.709361 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-00420e6a-ca00-4442-bc9d-03c768944d0d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:15.894934 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-a4407db5-3f21-45e4-bd99-4067e041270c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:15.907172 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-a4407db5-3f21-45e4-bd99-4067e041270c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1315 microversion: 2.1 time: 0.281495 Aug 26 15:57:15.907882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 30/78] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:15 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:15.989350 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-19cc6eda-ab74-4779-a81c-a5babe4d70bc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:16.001170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-19cc6eda-ab74-4779-a81c-a5babe4d70bc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:16.001170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-19cc6eda-ab74-4779-a81c-a5babe4d70bc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:16.001170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-19cc6eda-ab74-4779-a81c-a5babe4d70bc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:16.001617 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-19cc6eda-ab74-4779-a81c-a5babe4d70bc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:16.002419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-19cc6eda-ab74-4779-a81c-a5babe4d70bc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:16.002905 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-19cc6eda-ab74-4779-a81c-a5babe4d70bc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:16.003387 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-19cc6eda-ab74-4779-a81c-a5babe4d70bc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:16.057613 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-00420e6a-ca00-4442-bc9d-03c768944d0d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:16.067470 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-00420e6a-ca00-4442-bc9d-03c768944d0d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:16.068930 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-00420e6a-ca00-4442-bc9d-03c768944d0d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:16.070388 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-00420e6a-ca00-4442-bc9d-03c768944d0d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1408 microversion: 2.20 time: 0.377884 Aug 26 15:57:16.087657 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 49/79] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:15 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1408 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:57:16.091621 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-064c8451-6353-4b19-91d7-9f2f9e3f6507 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:16.093551 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-064c8451-6353-4b19-91d7-9f2f9e3f6507 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:16.106718 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-064c8451-6353-4b19-91d7-9f2f9e3f6507 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:16.107712 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-064c8451-6353-4b19-91d7-9f2f9e3f6507 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:16.110563 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-064c8451-6353-4b19-91d7-9f2f9e3f6507 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:16.110563 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-064c8451-6353-4b19-91d7-9f2f9e3f6507 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:16.110563 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-064c8451-6353-4b19-91d7-9f2f9e3f6507 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:16.110563 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-064c8451-6353-4b19-91d7-9f2f9e3f6507 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:16.329514 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-19cc6eda-ab74-4779-a81c-a5babe4d70bc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:16.344259 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-19cc6eda-ab74-4779-a81c-a5babe4d70bc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1367 microversion: 2.1 time: 0.359367 Aug 26 15:57:16.369351 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 31/80] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:15 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1367 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:16.381310 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-a8c7909a-9d57-4583-a16b-9a32337158ca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:16.385461 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-a8c7909a-9d57-4583-a16b-9a32337158ca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:16.396614 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a8c7909a-9d57-4583-a16b-9a32337158ca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:16.400865 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a8c7909a-9d57-4583-a16b-9a32337158ca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:16.400865 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a8c7909a-9d57-4583-a16b-9a32337158ca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:16.400865 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a8c7909a-9d57-4583-a16b-9a32337158ca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:16.400865 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a8c7909a-9d57-4583-a16b-9a32337158ca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:16.401208 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a8c7909a-9d57-4583-a16b-9a32337158ca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:16.439652 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-064c8451-6353-4b19-91d7-9f2f9e3f6507 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:16.455439 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-064c8451-6353-4b19-91d7-9f2f9e3f6507 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1363 microversion: 2.1 time: 0.370957 Aug 26 15:57:16.455709 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 50/81] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:16 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1363 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:16.588569 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-a8c7909a-9d57-4583-a16b-9a32337158ca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:16.597869 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-a8c7909a-9d57-4583-a16b-9a32337158ca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1322 microversion: 2.1 time: 0.227341 Aug 26 15:57:16.598718 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 32/82] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:16 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:16.932924 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-02712b49-e2b4-41f9-b86f-cfe2e531f113 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:16.937502 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-02712b49-e2b4-41f9-b86f-cfe2e531f113 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:16.952149 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-02712b49-e2b4-41f9-b86f-cfe2e531f113 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:16.953327 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-02712b49-e2b4-41f9-b86f-cfe2e531f113 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:16.954056 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-02712b49-e2b4-41f9-b86f-cfe2e531f113 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:16.955024 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-02712b49-e2b4-41f9-b86f-cfe2e531f113 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:16.955692 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-02712b49-e2b4-41f9-b86f-cfe2e531f113 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:16.956383 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-02712b49-e2b4-41f9-b86f-cfe2e531f113 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:16.976632 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=100 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:57:17.095390 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-55fee89f-7f8e-41b0-80b4-436b94b32335 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:17.096705 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-55fee89f-7f8e-41b0-80b4-436b94b32335 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:17.105908 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-55fee89f-7f8e-41b0-80b4-436b94b32335 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:17.106331 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-55fee89f-7f8e-41b0-80b4-436b94b32335 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:17.106773 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-55fee89f-7f8e-41b0-80b4-436b94b32335 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:17.108353 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-55fee89f-7f8e-41b0-80b4-436b94b32335 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:17.108939 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-55fee89f-7f8e-41b0-80b4-436b94b32335 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:17.109377 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-55fee89f-7f8e-41b0-80b4-436b94b32335 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:17.164044 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-02712b49-e2b4-41f9-b86f-cfe2e531f113 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:17.174552 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-02712b49-e2b4-41f9-b86f-cfe2e531f113 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1315 microversion: 2.1 time: 0.245972 Aug 26 15:57:17.189738 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 51/83] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:16 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:17.278476 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-55fee89f-7f8e-41b0-80b4-436b94b32335 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:17.289971 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-55fee89f-7f8e-41b0-80b4-436b94b32335 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:17.289971 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-55fee89f-7f8e-41b0-80b4-436b94b32335 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:17.290972 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-55fee89f-7f8e-41b0-80b4-436b94b32335 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1408 microversion: 2.20 time: 0.199884 Aug 26 15:57:17.291538 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 33/84] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:17 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:57:17.367854 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-d1a14f73-776e-4675-95db-80fff75b372e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:17.372597 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-d1a14f73-776e-4675-95db-80fff75b372e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:17.375417 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d1a14f73-776e-4675-95db-80fff75b372e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:17.375908 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d1a14f73-776e-4675-95db-80fff75b372e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:17.376372 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d1a14f73-776e-4675-95db-80fff75b372e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:17.377247 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d1a14f73-776e-4675-95db-80fff75b372e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:17.377983 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d1a14f73-776e-4675-95db-80fff75b372e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:17.378695 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d1a14f73-776e-4675-95db-80fff75b372e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:17.475323 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-e2d307d9-f4e0-42ee-b6a1-df922b27125d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:17.479226 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-e2d307d9-f4e0-42ee-b6a1-df922b27125d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:17.487509 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e2d307d9-f4e0-42ee-b6a1-df922b27125d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:17.487781 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e2d307d9-f4e0-42ee-b6a1-df922b27125d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:17.488224 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e2d307d9-f4e0-42ee-b6a1-df922b27125d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:17.488930 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e2d307d9-f4e0-42ee-b6a1-df922b27125d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:17.489387 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e2d307d9-f4e0-42ee-b6a1-df922b27125d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:17.489819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e2d307d9-f4e0-42ee-b6a1-df922b27125d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:17.567894 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d1a14f73-776e-4675-95db-80fff75b372e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:17.583653 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-d1a14f73-776e-4675-95db-80fff75b372e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1367 microversion: 2.1 time: 0.220272 Aug 26 15:57:17.584802 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 52/85] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:17 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:17.619569 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-959d6713-ca05-4fdd-89d0-993a248472e8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:17.620325 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-959d6713-ca05-4fdd-89d0-993a248472e8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:17.628216 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-959d6713-ca05-4fdd-89d0-993a248472e8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:17.628700 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-959d6713-ca05-4fdd-89d0-993a248472e8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:17.630268 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-959d6713-ca05-4fdd-89d0-993a248472e8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:17.631416 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-959d6713-ca05-4fdd-89d0-993a248472e8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:17.632250 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-959d6713-ca05-4fdd-89d0-993a248472e8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:17.632844 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-959d6713-ca05-4fdd-89d0-993a248472e8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:17.634481 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e2d307d9-f4e0-42ee-b6a1-df922b27125d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:17.643674 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-e2d307d9-f4e0-42ee-b6a1-df922b27125d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1363 microversion: 2.1 time: 0.172039 Aug 26 15:57:17.644265 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 34/86] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:17 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:18.007015 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-959d6713-ca05-4fdd-89d0-993a248472e8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:18.015266 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-959d6713-ca05-4fdd-89d0-993a248472e8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1322 microversion: 2.1 time: 0.399528 Aug 26 15:57:18.015847 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 53/87] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:17 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1322 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:18.195947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-b5927972-8360-44ec-9896-cb17667c4692 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:18.197049 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-b5927972-8360-44ec-9896-cb17667c4692 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:18.205390 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b5927972-8360-44ec-9896-cb17667c4692 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:18.206230 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b5927972-8360-44ec-9896-cb17667c4692 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:18.206795 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b5927972-8360-44ec-9896-cb17667c4692 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:18.207599 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b5927972-8360-44ec-9896-cb17667c4692 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:18.208127 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b5927972-8360-44ec-9896-cb17667c4692 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:18.208624 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b5927972-8360-44ec-9896-cb17667c4692 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:18.315475 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a1b01680-4066-408d-a74d-3a0cd37672d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:18.319167 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a1b01680-4066-408d-a74d-3a0cd37672d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:18.325367 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a1b01680-4066-408d-a74d-3a0cd37672d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:18.328891 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a1b01680-4066-408d-a74d-3a0cd37672d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:18.328891 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a1b01680-4066-408d-a74d-3a0cd37672d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:18.328891 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a1b01680-4066-408d-a74d-3a0cd37672d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:18.328891 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a1b01680-4066-408d-a74d-3a0cd37672d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:18.329641 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a1b01680-4066-408d-a74d-3a0cd37672d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:18.369561 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-b5927972-8360-44ec-9896-cb17667c4692 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:18.369561 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-b5927972-8360-44ec-9896-cb17667c4692 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1315 microversion: 2.1 time: 0.173066 Aug 26 15:57:18.369561 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 35/88] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:18 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:18.483387 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a1b01680-4066-408d-a74d-3a0cd37672d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:18.491884 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a1b01680-4066-408d-a74d-3a0cd37672d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:18.493363 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a1b01680-4066-408d-a74d-3a0cd37672d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:18.494514 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a1b01680-4066-408d-a74d-3a0cd37672d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1408 microversion: 2.20 time: 0.184445 Aug 26 15:57:18.502983 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 54/89] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:18 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:57:18.605052 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-93fc78c5-1a5c-458b-a000-aa2d1e707279 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:18.605669 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-93fc78c5-1a5c-458b-a000-aa2d1e707279 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:18.612366 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-93fc78c5-1a5c-458b-a000-aa2d1e707279 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:18.612853 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-93fc78c5-1a5c-458b-a000-aa2d1e707279 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:18.613316 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-93fc78c5-1a5c-458b-a000-aa2d1e707279 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:18.613990 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-93fc78c5-1a5c-458b-a000-aa2d1e707279 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:18.614444 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-93fc78c5-1a5c-458b-a000-aa2d1e707279 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:18.615158 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-93fc78c5-1a5c-458b-a000-aa2d1e707279 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:18.665192 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-60a79d9b-beec-405c-83b3-a53654e87b5b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:18.665795 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-60a79d9b-beec-405c-83b3-a53654e87b5b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:18.672704 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-60a79d9b-beec-405c-83b3-a53654e87b5b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:18.673299 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-60a79d9b-beec-405c-83b3-a53654e87b5b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:18.673820 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-60a79d9b-beec-405c-83b3-a53654e87b5b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:18.674654 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-60a79d9b-beec-405c-83b3-a53654e87b5b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:18.675139 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-60a79d9b-beec-405c-83b3-a53654e87b5b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:18.675642 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-60a79d9b-beec-405c-83b3-a53654e87b5b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:19.214461 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-93fc78c5-1a5c-458b-a000-aa2d1e707279 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:19.224400 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-93fc78c5-1a5c-458b-a000-aa2d1e707279 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1367 microversion: 2.1 time: 0.623163 Aug 26 15:57:19.236309 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 36/90] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:18 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1367 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:19.236309 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-3d567e50-5a48-443c-9df5-ea014229bfc1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:19.236309 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-3d567e50-5a48-443c-9df5-ea014229bfc1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:19.236816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-60a79d9b-beec-405c-83b3-a53654e87b5b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:19.246533 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3d567e50-5a48-443c-9df5-ea014229bfc1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:19.247028 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3d567e50-5a48-443c-9df5-ea014229bfc1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:19.247460 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3d567e50-5a48-443c-9df5-ea014229bfc1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:19.249119 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3d567e50-5a48-443c-9df5-ea014229bfc1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:19.250323 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3d567e50-5a48-443c-9df5-ea014229bfc1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:19.250323 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3d567e50-5a48-443c-9df5-ea014229bfc1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:19.251129 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-60a79d9b-beec-405c-83b3-a53654e87b5b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1363 microversion: 2.1 time: 0.588520 Aug 26 15:57:19.251812 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 55/91] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:18 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1363 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:19.385360 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-640ba267-c65a-44cd-a81b-361d6f79cb69 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:19.386046 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-640ba267-c65a-44cd-a81b-361d6f79cb69 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:19.392196 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-640ba267-c65a-44cd-a81b-361d6f79cb69 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:19.392677 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-640ba267-c65a-44cd-a81b-361d6f79cb69 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:19.393102 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-640ba267-c65a-44cd-a81b-361d6f79cb69 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:19.393817 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-640ba267-c65a-44cd-a81b-361d6f79cb69 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:19.394258 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-640ba267-c65a-44cd-a81b-361d6f79cb69 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:19.394679 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-640ba267-c65a-44cd-a81b-361d6f79cb69 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:19.628339 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-3d567e50-5a48-443c-9df5-ea014229bfc1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:19.640646 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-3d567e50-5a48-443c-9df5-ea014229bfc1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1322 microversion: 2.1 time: 0.414267 Aug 26 15:57:19.641465 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 37/92] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:19 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:19.657952 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-fa26942d-e2d9-4c69-b5fe-1d9de0445670 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:19.659043 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-fa26942d-e2d9-4c69-b5fe-1d9de0445670 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:19.665474 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fa26942d-e2d9-4c69-b5fe-1d9de0445670 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:19.665948 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fa26942d-e2d9-4c69-b5fe-1d9de0445670 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:19.666370 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fa26942d-e2d9-4c69-b5fe-1d9de0445670 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:19.667365 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fa26942d-e2d9-4c69-b5fe-1d9de0445670 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:19.668016 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fa26942d-e2d9-4c69-b5fe-1d9de0445670 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:19.668650 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fa26942d-e2d9-4c69-b5fe-1d9de0445670 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:19.724519 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-640ba267-c65a-44cd-a81b-361d6f79cb69 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:19.740053 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-640ba267-c65a-44cd-a81b-361d6f79cb69 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1315 microversion: 2.1 time: 0.358343 Aug 26 15:57:19.741223 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 56/93] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:19 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:57:19.897507 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-fa26942d-e2d9-4c69-b5fe-1d9de0445670 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:19.906776 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-fa26942d-e2d9-4c69-b5fe-1d9de0445670 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:19.908558 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-fa26942d-e2d9-4c69-b5fe-1d9de0445670 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:19.909956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-fa26942d-e2d9-4c69-b5fe-1d9de0445670 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1408 microversion: 2.20 time: 0.267465 Aug 26 15:57:19.911023 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 38/94] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:19 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1408 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:20.251050 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-9aa62474-663c-4643-b69e-07980f6a4214 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:20.251765 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-9aa62474-663c-4643-b69e-07980f6a4214 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:20.258462 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9aa62474-663c-4643-b69e-07980f6a4214 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:20.259109 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9aa62474-663c-4643-b69e-07980f6a4214 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:20.259749 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9aa62474-663c-4643-b69e-07980f6a4214 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:20.260620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9aa62474-663c-4643-b69e-07980f6a4214 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:20.261250 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9aa62474-663c-4643-b69e-07980f6a4214 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:20.261668 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9aa62474-663c-4643-b69e-07980f6a4214 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:20.275959 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-d70b6133-4bf9-4bab-aad1-24300ce1efb6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:20.278081 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-d70b6133-4bf9-4bab-aad1-24300ce1efb6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:20.285712 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d70b6133-4bf9-4bab-aad1-24300ce1efb6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:20.286482 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d70b6133-4bf9-4bab-aad1-24300ce1efb6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:20.287222 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d70b6133-4bf9-4bab-aad1-24300ce1efb6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:20.288660 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d70b6133-4bf9-4bab-aad1-24300ce1efb6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:20.289397 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d70b6133-4bf9-4bab-aad1-24300ce1efb6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:20.290023 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d70b6133-4bf9-4bab-aad1-24300ce1efb6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:20.630263 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-d70b6133-4bf9-4bab-aad1-24300ce1efb6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:20.645580 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-d70b6133-4bf9-4bab-aad1-24300ce1efb6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1363 microversion: 2.1 time: 0.373727 Aug 26 15:57:20.659571 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-9aa62474-663c-4643-b69e-07980f6a4214 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:20.661720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 39/95] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:20 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1363 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:57:20.667722 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-9aa62474-663c-4643-b69e-07980f6a4214 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1367 microversion: 2.1 time: 0.422489 Aug 26 15:57:20.668017 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-58bef1a1-7fc4-4ba2-974b-b95615f04cff req-5afdeabe-8714-44f0-880c-b463d80216cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ac977a7-aa08-459a-a863-36ba667422d1", "tag": "8a53b00a-319e-4368-a0b0-216d2f508b1d"}, {"name": "network-changed", "server_uuid": "f0e476ca-b4b7-4537-bfca-2c66b7246c3e", "tag": "51cd4e58-b1f3-4e1f-b212-98868414d616"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:57:20.669072 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 57/96] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:20 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1367 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:20.674766 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-49291f97-a99a-4ee5-ae01-4fe3b200dd5d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:20.675513 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-49291f97-a99a-4ee5-ae01-4fe3b200dd5d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:20.681924 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-49291f97-a99a-4ee5-ae01-4fe3b200dd5d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:20.682724 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-49291f97-a99a-4ee5-ae01-4fe3b200dd5d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:20.683286 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-49291f97-a99a-4ee5-ae01-4fe3b200dd5d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:20.684212 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-49291f97-a99a-4ee5-ae01-4fe3b200dd5d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:20.684878 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-49291f97-a99a-4ee5-ae01-4fe3b200dd5d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:20.685769 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-49291f97-a99a-4ee5-ae01-4fe3b200dd5d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:20.696627 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-58bef1a1-7fc4-4ba2-974b-b95615f04cff req-5afdeabe-8714-44f0-880c-b463d80216cb service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:20.697295 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-58bef1a1-7fc4-4ba2-974b-b95615f04cff req-5afdeabe-8714-44f0-880c-b463d80216cb service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:20.698027 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-58bef1a1-7fc4-4ba2-974b-b95615f04cff req-5afdeabe-8714-44f0-880c-b463d80216cb service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:20.713816 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-58bef1a1-7fc4-4ba2-974b-b95615f04cff req-5afdeabe-8714-44f0-880c-b463d80216cb service nova] Creating event network-changed:8a53b00a-319e-4368-a0b0-216d2f508b1d for instance 8ac977a7-aa08-459a-a863-36ba667422d1 on hv-cinder-85144 Aug 26 15:57:20.714492 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-58bef1a1-7fc4-4ba2-974b-b95615f04cff req-5afdeabe-8714-44f0-880c-b463d80216cb service nova] Creating event network-changed:51cd4e58-b1f3-4e1f-b212-98868414d616 for instance f0e476ca-b4b7-4537-bfca-2c66b7246c3e on hv-cinder-85144 Aug 26 15:57:20.722279 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-58bef1a1-7fc4-4ba2-974b-b95615f04cff req-5afdeabe-8714-44f0-880c-b463d80216cb service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.058994 Aug 26 15:57:20.723072 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 40/97] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 15:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:57:20.762758 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ba40f492-2280-4215-b70a-10fd878f39fe tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:20.763597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ba40f492-2280-4215-b70a-10fd878f39fe tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:20.770180 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba40f492-2280-4215-b70a-10fd878f39fe tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:20.770674 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba40f492-2280-4215-b70a-10fd878f39fe tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:20.771487 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba40f492-2280-4215-b70a-10fd878f39fe tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:20.772188 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba40f492-2280-4215-b70a-10fd878f39fe tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:20.772645 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba40f492-2280-4215-b70a-10fd878f39fe tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:20.773072 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba40f492-2280-4215-b70a-10fd878f39fe tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:20.870462 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-49291f97-a99a-4ee5-ae01-4fe3b200dd5d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:20.880528 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-49291f97-a99a-4ee5-ae01-4fe3b200dd5d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1322 microversion: 2.1 time: 0.209586 Aug 26 15:57:20.881096 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 58/98] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:20 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:20.933996 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-0f9a2d23-08c3-4c6a-a352-f651f8c59c23 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:20.934657 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-0f9a2d23-08c3-4c6a-a352-f651f8c59c23 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:20.935209 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-ba40f492-2280-4215-b70a-10fd878f39fe tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:20.941105 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0f9a2d23-08c3-4c6a-a352-f651f8c59c23 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:20.941541 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0f9a2d23-08c3-4c6a-a352-f651f8c59c23 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:20.941975 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0f9a2d23-08c3-4c6a-a352-f651f8c59c23 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:20.942667 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0f9a2d23-08c3-4c6a-a352-f651f8c59c23 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:20.943392 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0f9a2d23-08c3-4c6a-a352-f651f8c59c23 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:20.943914 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0f9a2d23-08c3-4c6a-a352-f651f8c59c23 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:20.946609 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ba40f492-2280-4215-b70a-10fd878f39fe tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1315 microversion: 2.1 time: 0.187992 Aug 26 15:57:20.958954 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 41/99] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:20 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:21.096981 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-0f9a2d23-08c3-4c6a-a352-f651f8c59c23 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:21.109355 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-0f9a2d23-08c3-4c6a-a352-f651f8c59c23 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:21.114880 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-0f9a2d23-08c3-4c6a-a352-f651f8c59c23 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:21.116536 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-0f9a2d23-08c3-4c6a-a352-f651f8c59c23 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1408 microversion: 2.20 time: 0.186778 Aug 26 15:57:21.119430 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 59/100] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:20 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:57:21.671743 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-1fe978d3-abd0-46db-8679-3932f6ab208a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:21.672480 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-1fe978d3-abd0-46db-8679-3932f6ab208a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:21.679749 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell0:SELECT=10 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:57:21.682315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1fe978d3-abd0-46db-8679-3932f6ab208a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:21.684272 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1fe978d3-abd0-46db-8679-3932f6ab208a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:21.684272 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1fe978d3-abd0-46db-8679-3932f6ab208a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:21.684762 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1fe978d3-abd0-46db-8679-3932f6ab208a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:21.686351 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1fe978d3-abd0-46db-8679-3932f6ab208a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:21.687476 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1fe978d3-abd0-46db-8679-3932f6ab208a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:21.692239 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-c9f653fc-bfe0-4116-9c07-7bf4ab677f15 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:21.693084 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-c9f653fc-bfe0-4116-9c07-7bf4ab677f15 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:21.708172 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c9f653fc-bfe0-4116-9c07-7bf4ab677f15 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:21.711433 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c9f653fc-bfe0-4116-9c07-7bf4ab677f15 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:21.711876 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c9f653fc-bfe0-4116-9c07-7bf4ab677f15 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:21.713697 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c9f653fc-bfe0-4116-9c07-7bf4ab677f15 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:21.714169 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c9f653fc-bfe0-4116-9c07-7bf4ab677f15 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:21.714603 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c9f653fc-bfe0-4116-9c07-7bf4ab677f15 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:21.944282 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-c9f653fc-bfe0-4116-9c07-7bf4ab677f15 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:21.956700 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-c9f653fc-bfe0-4116-9c07-7bf4ab677f15 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1367 microversion: 2.1 time: 0.268155 Aug 26 15:57:21.971098 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-1fe978d3-abd0-46db-8679-3932f6ab208a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:21.971098 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-1fe978d3-abd0-46db-8679-3932f6ab208a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1363 microversion: 2.1 time: 0.302897 Aug 26 15:57:21.972264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 60/101] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:21 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:21.977368 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-8cfb9524-e7da-4685-bd0a-a9938903c7d6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:21.978054 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-8cfb9524-e7da-4685-bd0a-a9938903c7d6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:21.983213 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 42/102] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:21 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1363 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:21.985770 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8cfb9524-e7da-4685-bd0a-a9938903c7d6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:21.989626 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8cfb9524-e7da-4685-bd0a-a9938903c7d6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:21.989626 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8cfb9524-e7da-4685-bd0a-a9938903c7d6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:21.989626 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8cfb9524-e7da-4685-bd0a-a9938903c7d6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:21.989626 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8cfb9524-e7da-4685-bd0a-a9938903c7d6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:21.990181 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8cfb9524-e7da-4685-bd0a-a9938903c7d6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:22.007503 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-372f19a5-1fb1-4882-819f-0b6505657018 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:22.008143 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-372f19a5-1fb1-4882-819f-0b6505657018 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:22.024263 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-372f19a5-1fb1-4882-819f-0b6505657018 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:22.024745 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-372f19a5-1fb1-4882-819f-0b6505657018 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:22.025184 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-372f19a5-1fb1-4882-819f-0b6505657018 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:22.029970 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-372f19a5-1fb1-4882-819f-0b6505657018 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:22.030456 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-372f19a5-1fb1-4882-819f-0b6505657018 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:22.030902 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-372f19a5-1fb1-4882-819f-0b6505657018 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:22.723388 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-8cfb9524-e7da-4685-bd0a-a9938903c7d6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:22.735264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-8cfb9524-e7da-4685-bd0a-a9938903c7d6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1322 microversion: 2.1 time: 0.761619 Aug 26 15:57:22.736057 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 61/103] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:21 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1322 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:22.736907 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-372f19a5-1fb1-4882-819f-0b6505657018 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:22.742504 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-fb5f1aec-f087-4c6e-96f7-b80da866f506 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:22.743809 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-fb5f1aec-f087-4c6e-96f7-b80da866f506 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:22.746303 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-372f19a5-1fb1-4882-819f-0b6505657018 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1315 microversion: 2.1 time: 0.748968 Aug 26 15:57:22.751579 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fb5f1aec-f087-4c6e-96f7-b80da866f506 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:22.753026 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fb5f1aec-f087-4c6e-96f7-b80da866f506 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:22.753855 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fb5f1aec-f087-4c6e-96f7-b80da866f506 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:22.755123 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fb5f1aec-f087-4c6e-96f7-b80da866f506 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:22.755771 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fb5f1aec-f087-4c6e-96f7-b80da866f506 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:22.756359 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fb5f1aec-f087-4c6e-96f7-b80da866f506 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:22.761610 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 43/104] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:21 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1315 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:22.889556 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-fb5f1aec-f087-4c6e-96f7-b80da866f506 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:22.897626 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-fb5f1aec-f087-4c6e-96f7-b80da866f506 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:22.899113 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-fb5f1aec-f087-4c6e-96f7-b80da866f506 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:22.900204 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-fb5f1aec-f087-4c6e-96f7-b80da866f506 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1408 microversion: 2.20 time: 0.162987 Aug 26 15:57:22.900836 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 62/105] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:22 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:22.977752 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-6be473ef-157a-422e-9f5c-35fff917d08f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:22.978410 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-6be473ef-157a-422e-9f5c-35fff917d08f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:22.986049 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6be473ef-157a-422e-9f5c-35fff917d08f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:22.986623 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6be473ef-157a-422e-9f5c-35fff917d08f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:22.987003 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6be473ef-157a-422e-9f5c-35fff917d08f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:22.987954 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6be473ef-157a-422e-9f5c-35fff917d08f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:22.988618 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6be473ef-157a-422e-9f5c-35fff917d08f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:22.989312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6be473ef-157a-422e-9f5c-35fff917d08f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:22.989607 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-8c052c02-2190-4aad-9e80-9143a01bff22 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:22.990211 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-8c052c02-2190-4aad-9e80-9143a01bff22 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:22.998793 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8c052c02-2190-4aad-9e80-9143a01bff22 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:23.004792 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8c052c02-2190-4aad-9e80-9143a01bff22 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:23.004792 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8c052c02-2190-4aad-9e80-9143a01bff22 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:23.004792 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8c052c02-2190-4aad-9e80-9143a01bff22 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:23.004792 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8c052c02-2190-4aad-9e80-9143a01bff22 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:23.005135 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8c052c02-2190-4aad-9e80-9143a01bff22 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:23.244062 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-6be473ef-157a-422e-9f5c-35fff917d08f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:23.247250 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-8c052c02-2190-4aad-9e80-9143a01bff22 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:23.254436 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-6be473ef-157a-422e-9f5c-35fff917d08f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1367 microversion: 2.1 time: 0.280540 Aug 26 15:57:23.255468 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 44/106] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:22 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:23.267096 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-8c052c02-2190-4aad-9e80-9143a01bff22 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1363 microversion: 2.1 time: 0.269889 Aug 26 15:57:23.267096 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 63/107] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:22 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:57:23.757765 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-8ba1ee9b-e36f-4a76-bce5-3998e22eecb6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:23.758620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-8ba1ee9b-e36f-4a76-bce5-3998e22eecb6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:23.771848 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7ddcca28-983b-4328-9ecb-0e26963a310d tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:23.772475 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-7ddcca28-983b-4328-9ecb-0e26963a310d tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:23.772779 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8ba1ee9b-e36f-4a76-bce5-3998e22eecb6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:23.773658 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8ba1ee9b-e36f-4a76-bce5-3998e22eecb6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:23.778146 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8ba1ee9b-e36f-4a76-bce5-3998e22eecb6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:23.786251 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8ba1ee9b-e36f-4a76-bce5-3998e22eecb6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:23.795848 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7ddcca28-983b-4328-9ecb-0e26963a310d tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:23.796947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7ddcca28-983b-4328-9ecb-0e26963a310d tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:23.797369 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7ddcca28-983b-4328-9ecb-0e26963a310d tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:23.801610 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7ddcca28-983b-4328-9ecb-0e26963a310d tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:23.803160 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8ba1ee9b-e36f-4a76-bce5-3998e22eecb6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:23.804746 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8ba1ee9b-e36f-4a76-bce5-3998e22eecb6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:23.805770 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7ddcca28-983b-4328-9ecb-0e26963a310d tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:23.806527 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7ddcca28-983b-4328-9ecb-0e26963a310d tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:23.864035 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=100 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:57:24.567151 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7ddcca28-983b-4328-9ecb-0e26963a310d tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:24.580015 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-7ddcca28-983b-4328-9ecb-0e26963a310d tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1315 microversion: 2.1 time: 0.813754 Aug 26 15:57:24.580617 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 45/108] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:23 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1315 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:24.594001 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-4cc55a0f-53cd-4f7d-a056-669cec92ec40 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:24.594618 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-4cc55a0f-53cd-4f7d-a056-669cec92ec40 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:24.599689 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-8ba1ee9b-e36f-4a76-bce5-3998e22eecb6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:24.600788 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4cc55a0f-53cd-4f7d-a056-669cec92ec40 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:24.601600 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4cc55a0f-53cd-4f7d-a056-669cec92ec40 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:24.602046 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4cc55a0f-53cd-4f7d-a056-669cec92ec40 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:24.602750 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4cc55a0f-53cd-4f7d-a056-669cec92ec40 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:24.603288 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4cc55a0f-53cd-4f7d-a056-669cec92ec40 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:24.603905 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4cc55a0f-53cd-4f7d-a056-669cec92ec40 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:24.645265 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-8ba1ee9b-e36f-4a76-bce5-3998e22eecb6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1322 microversion: 2.1 time: 0.892304 Aug 26 15:57:24.645855 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 64/109] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:23 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1322 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:24.650653 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-40ed7962-f118-425b-8986-8650e664768d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:24.653166 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-40ed7962-f118-425b-8986-8650e664768d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:24.666566 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-40ed7962-f118-425b-8986-8650e664768d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:24.667026 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-40ed7962-f118-425b-8986-8650e664768d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:24.670129 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-40ed7962-f118-425b-8986-8650e664768d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:24.670129 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-40ed7962-f118-425b-8986-8650e664768d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:24.670129 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-40ed7962-f118-425b-8986-8650e664768d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:24.670129 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-40ed7962-f118-425b-8986-8650e664768d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:24.809246 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-4cc55a0f-53cd-4f7d-a056-669cec92ec40 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:24.833943 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-4cc55a0f-53cd-4f7d-a056-669cec92ec40 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:24.835913 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-4cc55a0f-53cd-4f7d-a056-669cec92ec40 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:24.838196 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-4cc55a0f-53cd-4f7d-a056-669cec92ec40 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1408 microversion: 2.20 time: 0.248250 Aug 26 15:57:24.849523 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 46/110] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:24 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1408 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:24.861627 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-84b98047-ada3-4526-915f-99a561a252d6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:24.862258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-84b98047-ada3-4526-915f-99a561a252d6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:24.869481 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-84b98047-ada3-4526-915f-99a561a252d6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:24.869973 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-84b98047-ada3-4526-915f-99a561a252d6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:24.870413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-84b98047-ada3-4526-915f-99a561a252d6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:24.871149 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-84b98047-ada3-4526-915f-99a561a252d6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:24.871605 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-84b98047-ada3-4526-915f-99a561a252d6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:24.872035 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-84b98047-ada3-4526-915f-99a561a252d6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:24.873663 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-40ed7962-f118-425b-8986-8650e664768d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:24.882432 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-40ed7962-f118-425b-8986-8650e664768d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1363 microversion: 2.1 time: 0.234826 Aug 26 15:57:24.882432 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 65/111] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:24 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:25.031559 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-a49ee4c0-c6f0-44f2-a96d-d77d64a42320 req-3b3e9ab0-653e-43f0-a3da-49624f91cae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c04e0499-9326-4fe8-8e28-80be6b0d7a14", "name": "network-vif-plugged", "status": "completed", "tag": "add18eae-55b9-4447-82eb-6d50b51bc859"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:57:25.049179 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-a49ee4c0-c6f0-44f2-a96d-d77d64a42320 req-3b3e9ab0-653e-43f0-a3da-49624f91cae0 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:25.049913 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-a49ee4c0-c6f0-44f2-a96d-d77d64a42320 req-3b3e9ab0-653e-43f0-a3da-49624f91cae0 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:25.050757 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-a49ee4c0-c6f0-44f2-a96d-d77d64a42320 req-3b3e9ab0-653e-43f0-a3da-49624f91cae0 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:25.079617 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-a49ee4c0-c6f0-44f2-a96d-d77d64a42320 req-3b3e9ab0-653e-43f0-a3da-49624f91cae0 service nova] Creating event network-vif-plugged:add18eae-55b9-4447-82eb-6d50b51bc859 for instance c04e0499-9326-4fe8-8e28-80be6b0d7a14 on hv-cinder-85144 Aug 26 15:57:25.080473 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-a49ee4c0-c6f0-44f2-a96d-d77d64a42320 req-3b3e9ab0-653e-43f0-a3da-49624f91cae0 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128305) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 26 15:57:25.082364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-a49ee4c0-c6f0-44f2-a96d-d77d64a42320 req-3b3e9ab0-653e-43f0-a3da-49624f91cae0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128305) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 26 15:57:25.082541 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-41cb3ef3-2abb-4326-b9d2-52c90179e04d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:25.083401 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-41cb3ef3-2abb-4326-b9d2-52c90179e04d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:25.084637 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-41cb3ef3-2abb-4326-b9d2-52c90179e04d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:25.085478 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-41cb3ef3-2abb-4326-b9d2-52c90179e04d None None] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:25.086220 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-41cb3ef3-2abb-4326-b9d2-52c90179e04d None None] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:25.086898 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-41cb3ef3-2abb-4326-b9d2-52c90179e04d None None] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:25.100934 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-84b98047-ada3-4526-915f-99a561a252d6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:25.102729 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.compute.rpcapi [None req-41cb3ef3-2abb-4326-b9d2-52c90179e04d None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 26 15:57:25.103985 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-41cb3ef3-2abb-4326-b9d2-52c90179e04d None None] Releasing lock "compute-rpcapi-router" {{(pid=128305) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 26 15:57:25.109662 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-84b98047-ada3-4526-915f-99a561a252d6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1367 microversion: 2.1 time: 0.258331 Aug 26 15:57:25.110246 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 47/112] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:24 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:25.135327 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-41cb3ef3-2abb-4326-b9d2-52c90179e04d None None] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200407 Aug 26 15:57:25.136154 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 66/113] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 15:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:57:25.600476 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-08574e25-b3a7-49a3-a288-ef41a0ba0079 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:25.601935 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-08574e25-b3a7-49a3-a288-ef41a0ba0079 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:25.614414 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-08574e25-b3a7-49a3-a288-ef41a0ba0079 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:25.614913 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-08574e25-b3a7-49a3-a288-ef41a0ba0079 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:25.615575 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-08574e25-b3a7-49a3-a288-ef41a0ba0079 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:25.628591 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-08574e25-b3a7-49a3-a288-ef41a0ba0079 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:25.635169 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-08574e25-b3a7-49a3-a288-ef41a0ba0079 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:25.635897 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-08574e25-b3a7-49a3-a288-ef41a0ba0079 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:25.667282 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-e84e3e1a-293e-48a9-86e3-2464702fc38b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:25.668838 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-e84e3e1a-293e-48a9-86e3-2464702fc38b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:25.685636 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e84e3e1a-293e-48a9-86e3-2464702fc38b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:25.686542 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e84e3e1a-293e-48a9-86e3-2464702fc38b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:25.687215 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e84e3e1a-293e-48a9-86e3-2464702fc38b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:25.691202 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e84e3e1a-293e-48a9-86e3-2464702fc38b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:25.692187 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e84e3e1a-293e-48a9-86e3-2464702fc38b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:25.694673 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e84e3e1a-293e-48a9-86e3-2464702fc38b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:26.415760 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-08574e25-b3a7-49a3-a288-ef41a0ba0079 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:26.453661 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-08574e25-b3a7-49a3-a288-ef41a0ba0079 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1315 microversion: 2.1 time: 0.857224 Aug 26 15:57:26.455951 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 48/114] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:25 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1315 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:26.457322 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-e84e3e1a-293e-48a9-86e3-2464702fc38b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:26.469320 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-a21649dc-b883-420f-81a5-eea8927cab3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:26.470418 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-e84e3e1a-293e-48a9-86e3-2464702fc38b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1322 microversion: 2.1 time: 0.807664 Aug 26 15:57:26.471084 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-a21649dc-b883-420f-81a5-eea8927cab3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:26.482396 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 67/115] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:25 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1322 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:57:26.490163 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-167cbd51-00ba-4d99-8f59-33ae6e072278 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:26.491026 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-167cbd51-00ba-4d99-8f59-33ae6e072278 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:26.497108 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a21649dc-b883-420f-81a5-eea8927cab3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:26.498285 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a21649dc-b883-420f-81a5-eea8927cab3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:26.499403 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-167cbd51-00ba-4d99-8f59-33ae6e072278 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:26.500113 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-167cbd51-00ba-4d99-8f59-33ae6e072278 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:26.501256 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-167cbd51-00ba-4d99-8f59-33ae6e072278 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:26.501514 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a21649dc-b883-420f-81a5-eea8927cab3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:26.502314 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-167cbd51-00ba-4d99-8f59-33ae6e072278 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:26.503186 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-167cbd51-00ba-4d99-8f59-33ae6e072278 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:26.503777 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-167cbd51-00ba-4d99-8f59-33ae6e072278 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:26.505345 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a21649dc-b883-420f-81a5-eea8927cab3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:26.505845 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a21649dc-b883-420f-81a5-eea8927cab3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:26.507833 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a21649dc-b883-420f-81a5-eea8927cab3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:26.538893 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=100 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:57:26.788767 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-167cbd51-00ba-4d99-8f59-33ae6e072278 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:26.800442 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-a21649dc-b883-420f-81a5-eea8927cab3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:26.806261 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-167cbd51-00ba-4d99-8f59-33ae6e072278 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1363 microversion: 2.1 time: 0.322612 Aug 26 15:57:26.807707 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 68/116] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:26 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1363 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:26.813696 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-a21649dc-b883-420f-81a5-eea8927cab3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:26.813696 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-a21649dc-b883-420f-81a5-eea8927cab3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:26.813696 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-a21649dc-b883-420f-81a5-eea8927cab3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1408 microversion: 2.20 time: 0.351672 Aug 26 15:57:26.814552 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-4bddc69d-ca8d-4d81-98f9-5c45af7bed3e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:26.815451 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-4bddc69d-ca8d-4d81-98f9-5c45af7bed3e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:26.823415 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4bddc69d-ca8d-4d81-98f9-5c45af7bed3e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:26.824157 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4bddc69d-ca8d-4d81-98f9-5c45af7bed3e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:26.824882 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4bddc69d-ca8d-4d81-98f9-5c45af7bed3e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:26.825211 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 49/117] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:26 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1408 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:26.826669 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4bddc69d-ca8d-4d81-98f9-5c45af7bed3e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:26.827834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4bddc69d-ca8d-4d81-98f9-5c45af7bed3e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:26.828572 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4bddc69d-ca8d-4d81-98f9-5c45af7bed3e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:26.992203 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-4bddc69d-ca8d-4d81-98f9-5c45af7bed3e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:26.995862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-4bddc69d-ca8d-4d81-98f9-5c45af7bed3e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1367 microversion: 2.1 time: 0.186840 Aug 26 15:57:27.003074 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 69/118] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:26 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:27.151258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-5a8b092b-2ab1-467a-a498-5ade4f9f9c97 req-645b1b82-3b1a-4628-bde4-3a309981a55a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4425d401-9f5d-4aa8-a568-35ee9cd768bf", "name": "network-vif-plugged", "status": "completed", "tag": "7e519cd9-1a52-4518-a7ed-6455ad985b10"}, {"server_uuid": "6103553d-b9c7-4ab7-aef1-3fd676bb0a8a", "name": "network-vif-plugged", "status": "completed", "tag": "c3d450c2-3d49-40aa-b88c-475438ac1fcc"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:57:27.162951 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-5a8b092b-2ab1-467a-a498-5ade4f9f9c97 req-645b1b82-3b1a-4628-bde4-3a309981a55a service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:27.163505 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-5a8b092b-2ab1-467a-a498-5ade4f9f9c97 req-645b1b82-3b1a-4628-bde4-3a309981a55a service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:27.166905 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-5a8b092b-2ab1-467a-a498-5ade4f9f9c97 req-645b1b82-3b1a-4628-bde4-3a309981a55a service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:27.180279 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-5a8b092b-2ab1-467a-a498-5ade4f9f9c97 req-645b1b82-3b1a-4628-bde4-3a309981a55a service nova] Creating event network-vif-plugged:7e519cd9-1a52-4518-a7ed-6455ad985b10 for instance 4425d401-9f5d-4aa8-a568-35ee9cd768bf on hv-cinder-85144 Aug 26 15:57:27.180803 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-5a8b092b-2ab1-467a-a498-5ade4f9f9c97 req-645b1b82-3b1a-4628-bde4-3a309981a55a service nova] Creating event network-vif-plugged:c3d450c2-3d49-40aa-b88c-475438ac1fcc for instance 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a on hv-cinder-85144 Aug 26 15:57:27.204733 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-5a8b092b-2ab1-467a-a498-5ade4f9f9c97 req-645b1b82-3b1a-4628-bde4-3a309981a55a service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041965 Aug 26 15:57:27.206652 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 50/119] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 15:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:57:27.476164 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-45fd0dca-9e81-482e-9256-2c07d5bcda5e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:27.476851 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-45fd0dca-9e81-482e-9256-2c07d5bcda5e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:27.483061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-45fd0dca-9e81-482e-9256-2c07d5bcda5e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:27.508678 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-45fd0dca-9e81-482e-9256-2c07d5bcda5e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:27.508678 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-45fd0dca-9e81-482e-9256-2c07d5bcda5e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:27.508678 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-45fd0dca-9e81-482e-9256-2c07d5bcda5e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:27.508678 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-45fd0dca-9e81-482e-9256-2c07d5bcda5e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:27.509083 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-45fd0dca-9e81-482e-9256-2c07d5bcda5e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:27.509176 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7d63467e-7c59-4e71-a75b-c3048b252f01 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:27.509176 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-7d63467e-7c59-4e71-a75b-c3048b252f01 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:27.509176 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7d63467e-7c59-4e71-a75b-c3048b252f01 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:27.509176 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7d63467e-7c59-4e71-a75b-c3048b252f01 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:27.509814 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7d63467e-7c59-4e71-a75b-c3048b252f01 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:27.509814 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7d63467e-7c59-4e71-a75b-c3048b252f01 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:27.509814 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7d63467e-7c59-4e71-a75b-c3048b252f01 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:27.509814 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7d63467e-7c59-4e71-a75b-c3048b252f01 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:27.704358 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-45fd0dca-9e81-482e-9256-2c07d5bcda5e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:27.712552 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-45fd0dca-9e81-482e-9256-2c07d5bcda5e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1315 microversion: 2.1 time: 0.240522 Aug 26 15:57:27.722046 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 70/120] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:27 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:27.730658 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7d63467e-7c59-4e71-a75b-c3048b252f01 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:27.739351 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-7d63467e-7c59-4e71-a75b-c3048b252f01 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1322 microversion: 2.1 time: 0.251456 Aug 26 15:57:27.739941 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 51/121] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:27 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:57:27.829676 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-47ed9019-c8c7-40f5-bbb7-98f4aa25a8df tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:27.830304 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-47ed9019-c8c7-40f5-bbb7-98f4aa25a8df tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:27.842806 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ee42943e-3144-451c-9498-d46e2e018bac tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:27.844940 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ee42943e-3144-451c-9498-d46e2e018bac tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:27.846395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-47ed9019-c8c7-40f5-bbb7-98f4aa25a8df tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:27.846893 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-47ed9019-c8c7-40f5-bbb7-98f4aa25a8df tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:27.847544 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-47ed9019-c8c7-40f5-bbb7-98f4aa25a8df tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:27.848590 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-47ed9019-c8c7-40f5-bbb7-98f4aa25a8df tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:27.849198 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-47ed9019-c8c7-40f5-bbb7-98f4aa25a8df tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:27.850209 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-47ed9019-c8c7-40f5-bbb7-98f4aa25a8df tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:27.854116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ee42943e-3144-451c-9498-d46e2e018bac tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:27.855277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ee42943e-3144-451c-9498-d46e2e018bac tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:27.855865 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ee42943e-3144-451c-9498-d46e2e018bac tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:27.856713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ee42943e-3144-451c-9498-d46e2e018bac tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:27.858603 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ee42943e-3144-451c-9498-d46e2e018bac tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:27.859252 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ee42943e-3144-451c-9498-d46e2e018bac tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:28.136558 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-47ed9019-c8c7-40f5-bbb7-98f4aa25a8df tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:28.144083 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-ee42943e-3144-451c-9498-d46e2e018bac tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:28.145385 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-47ed9019-c8c7-40f5-bbb7-98f4aa25a8df tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1363 microversion: 2.1 time: 0.320742 Aug 26 15:57:28.146055 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 71/122] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:27 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1363 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:28.151738 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-19da5641-c3e2-4da4-9d41-7f7655ba010c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:28.152370 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-19da5641-c3e2-4da4-9d41-7f7655ba010c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:28.152717 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-ee42943e-3144-451c-9498-d46e2e018bac tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:28.154308 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-ee42943e-3144-451c-9498-d46e2e018bac tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:28.155667 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ee42943e-3144-451c-9498-d46e2e018bac tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1408 microversion: 2.20 time: 0.323162 Aug 26 15:57:28.156486 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 52/123] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:27 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1408 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:28.159451 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-19da5641-c3e2-4da4-9d41-7f7655ba010c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:28.159936 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-19da5641-c3e2-4da4-9d41-7f7655ba010c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:28.160368 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-19da5641-c3e2-4da4-9d41-7f7655ba010c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:28.161065 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-19da5641-c3e2-4da4-9d41-7f7655ba010c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:28.161510 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-19da5641-c3e2-4da4-9d41-7f7655ba010c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:28.161930 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-19da5641-c3e2-4da4-9d41-7f7655ba010c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:28.382425 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-19da5641-c3e2-4da4-9d41-7f7655ba010c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:28.390381 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-19da5641-c3e2-4da4-9d41-7f7655ba010c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1367 microversion: 2.1 time: 0.242638 Aug 26 15:57:28.394331 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 72/124] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:28 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:28.735462 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-b3167c67-8f88-4b48-a533-a2da05df542f tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:28.736073 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-b3167c67-8f88-4b48-a533-a2da05df542f tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:28.742608 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b3167c67-8f88-4b48-a533-a2da05df542f tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:28.744177 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b3167c67-8f88-4b48-a533-a2da05df542f tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:28.749675 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b3167c67-8f88-4b48-a533-a2da05df542f tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:28.749675 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b3167c67-8f88-4b48-a533-a2da05df542f tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:28.749675 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b3167c67-8f88-4b48-a533-a2da05df542f tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:28.749675 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b3167c67-8f88-4b48-a533-a2da05df542f tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:28.760894 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-e006cec8-a9a8-411a-9686-2aef14108c55 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:28.761519 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-e006cec8-a9a8-411a-9686-2aef14108c55 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:28.770830 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e006cec8-a9a8-411a-9686-2aef14108c55 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:28.771417 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e006cec8-a9a8-411a-9686-2aef14108c55 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:28.772114 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e006cec8-a9a8-411a-9686-2aef14108c55 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:28.773023 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e006cec8-a9a8-411a-9686-2aef14108c55 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:28.773657 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e006cec8-a9a8-411a-9686-2aef14108c55 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:28.774280 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e006cec8-a9a8-411a-9686-2aef14108c55 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:28.953477 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-b3167c67-8f88-4b48-a533-a2da05df542f tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:28.961725 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-b3167c67-8f88-4b48-a533-a2da05df542f tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1315 microversion: 2.1 time: 0.230371 Aug 26 15:57:28.975504 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 53/125] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:28 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:28.979863 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-e006cec8-a9a8-411a-9686-2aef14108c55 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:28.988945 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-e006cec8-a9a8-411a-9686-2aef14108c55 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1322 microversion: 2.1 time: 0.231869 Aug 26 15:57:28.989858 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 73/126] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:28 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:29.166683 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-6d8c0cc0-97b8-4264-862f-1a6e60167404 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:29.167453 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-6d8c0cc0-97b8-4264-862f-1a6e60167404 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:29.174971 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6d8c0cc0-97b8-4264-862f-1a6e60167404 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:29.175722 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6d8c0cc0-97b8-4264-862f-1a6e60167404 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:29.176160 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6d8c0cc0-97b8-4264-862f-1a6e60167404 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:29.177160 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6d8c0cc0-97b8-4264-862f-1a6e60167404 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:29.177665 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6d8c0cc0-97b8-4264-862f-1a6e60167404 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:29.177848 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-828092ed-b5bc-409f-8835-a27713a024f3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:29.178060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6d8c0cc0-97b8-4264-862f-1a6e60167404 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:29.178828 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-828092ed-b5bc-409f-8835-a27713a024f3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:29.186347 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-828092ed-b5bc-409f-8835-a27713a024f3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:29.187039 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-828092ed-b5bc-409f-8835-a27713a024f3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:29.187744 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-828092ed-b5bc-409f-8835-a27713a024f3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:29.188892 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-828092ed-b5bc-409f-8835-a27713a024f3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:29.189591 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-828092ed-b5bc-409f-8835-a27713a024f3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:29.190220 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-828092ed-b5bc-409f-8835-a27713a024f3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:29.390827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-6d8c0cc0-97b8-4264-862f-1a6e60167404 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:29.398197 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-828092ed-b5bc-409f-8835-a27713a024f3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:29.404030 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-6d8c0cc0-97b8-4264-862f-1a6e60167404 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1363 microversion: 2.1 time: 0.241495 Aug 26 15:57:29.408379 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 54/127] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:29 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:29.415462 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-828092ed-b5bc-409f-8835-a27713a024f3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:29.419163 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-285453cf-3cfc-448a-830b-9d0dd7c958b5 req-84eeb628-918a-4027-885a-0af460aff87b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a7ee09-cb33-4638-a620-e36bc333cec6", "name": "network-vif-plugged", "status": "completed", "tag": "56c21eb3-a5af-49a5-afc3-c79bf7878007"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:57:29.419880 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-828092ed-b5bc-409f-8835-a27713a024f3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:29.422155 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-828092ed-b5bc-409f-8835-a27713a024f3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1408 microversion: 2.20 time: 0.247821 Aug 26 15:57:29.423284 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 74/128] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:29 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:57:29.432671 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-691acd8e-2e7b-4b08-b188-58819907b175 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:29.433937 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-691acd8e-2e7b-4b08-b188-58819907b175 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:29.446986 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-285453cf-3cfc-448a-830b-9d0dd7c958b5 req-84eeb628-918a-4027-885a-0af460aff87b service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:29.447473 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-285453cf-3cfc-448a-830b-9d0dd7c958b5 req-84eeb628-918a-4027-885a-0af460aff87b service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:29.447958 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-285453cf-3cfc-448a-830b-9d0dd7c958b5 req-84eeb628-918a-4027-885a-0af460aff87b service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:29.448661 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-691acd8e-2e7b-4b08-b188-58819907b175 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:29.449541 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-691acd8e-2e7b-4b08-b188-58819907b175 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:29.450285 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-691acd8e-2e7b-4b08-b188-58819907b175 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:29.451752 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-691acd8e-2e7b-4b08-b188-58819907b175 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:29.452835 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-691acd8e-2e7b-4b08-b188-58819907b175 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:29.453634 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-691acd8e-2e7b-4b08-b188-58819907b175 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:29.460975 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-285453cf-3cfc-448a-830b-9d0dd7c958b5 req-84eeb628-918a-4027-885a-0af460aff87b service nova] Creating event network-vif-plugged:56c21eb3-a5af-49a5-afc3-c79bf7878007 for instance 18a7ee09-cb33-4638-a620-e36bc333cec6 on hv-cinder-85144 Aug 26 15:57:29.466907 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-285453cf-3cfc-448a-830b-9d0dd7c958b5 req-84eeb628-918a-4027-885a-0af460aff87b service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059268 Aug 26 15:57:29.467553 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 55/129] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 15:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:57:29.602476 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-691acd8e-2e7b-4b08-b188-58819907b175 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:29.610783 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-691acd8e-2e7b-4b08-b188-58819907b175 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1367 microversion: 2.1 time: 0.185694 Aug 26 15:57:29.611422 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 75/130] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:29 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:29.985482 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-6e5d1dbb-4870-490b-9a46-3791940af7ab tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:29.986360 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-6e5d1dbb-4870-490b-9a46-3791940af7ab tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:29.992592 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6e5d1dbb-4870-490b-9a46-3791940af7ab tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:29.993082 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6e5d1dbb-4870-490b-9a46-3791940af7ab tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:29.993627 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6e5d1dbb-4870-490b-9a46-3791940af7ab tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:29.994307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6e5d1dbb-4870-490b-9a46-3791940af7ab tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:29.994763 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6e5d1dbb-4870-490b-9a46-3791940af7ab tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:29.995237 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6e5d1dbb-4870-490b-9a46-3791940af7ab tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:30.016928 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-0199c13f-23b0-4814-8550-be8eb270ede1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:30.017938 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-0199c13f-23b0-4814-8550-be8eb270ede1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:30.023929 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0199c13f-23b0-4814-8550-be8eb270ede1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:30.024414 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0199c13f-23b0-4814-8550-be8eb270ede1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:30.024850 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0199c13f-23b0-4814-8550-be8eb270ede1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:30.025542 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0199c13f-23b0-4814-8550-be8eb270ede1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:30.026022 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0199c13f-23b0-4814-8550-be8eb270ede1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:30.026448 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0199c13f-23b0-4814-8550-be8eb270ede1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:30.182195 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-6e5d1dbb-4870-490b-9a46-3791940af7ab tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:30.191186 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-6e5d1dbb-4870-490b-9a46-3791940af7ab tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1315 microversion: 2.1 time: 0.210464 Aug 26 15:57:30.191966 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 56/131] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:29 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:30.204253 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-0199c13f-23b0-4814-8550-be8eb270ede1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:30.212108 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-0199c13f-23b0-4814-8550-be8eb270ede1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1322 microversion: 2.1 time: 0.199576 Aug 26 15:57:30.212748 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 76/132] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:30 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:57:30.425685 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-624a94a9-5da0-4bf8-9940-f568e7b28a4c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:30.426295 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-624a94a9-5da0-4bf8-9940-f568e7b28a4c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:30.432228 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-624a94a9-5da0-4bf8-9940-f568e7b28a4c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:30.432707 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-624a94a9-5da0-4bf8-9940-f568e7b28a4c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:30.433140 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-624a94a9-5da0-4bf8-9940-f568e7b28a4c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:30.433917 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-624a94a9-5da0-4bf8-9940-f568e7b28a4c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:30.434373 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-624a94a9-5da0-4bf8-9940-f568e7b28a4c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:30.434799 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-624a94a9-5da0-4bf8-9940-f568e7b28a4c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:30.448289 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-4643b3f6-7b11-4a41-95bd-0ea461b2894f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:30.449136 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-4643b3f6-7b11-4a41-95bd-0ea461b2894f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:30.456099 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4643b3f6-7b11-4a41-95bd-0ea461b2894f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:30.456709 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4643b3f6-7b11-4a41-95bd-0ea461b2894f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:30.457252 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4643b3f6-7b11-4a41-95bd-0ea461b2894f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:30.458052 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4643b3f6-7b11-4a41-95bd-0ea461b2894f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:30.458605 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4643b3f6-7b11-4a41-95bd-0ea461b2894f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:30.459166 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4643b3f6-7b11-4a41-95bd-0ea461b2894f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:30.852750 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-624a94a9-5da0-4bf8-9940-f568e7b28a4c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:30.856139 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-4643b3f6-7b11-4a41-95bd-0ea461b2894f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:30.863351 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-624a94a9-5da0-4bf8-9940-f568e7b28a4c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1363 microversion: 2.1 time: 0.441224 Aug 26 15:57:30.864893 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-4643b3f6-7b11-4a41-95bd-0ea461b2894f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:30.866313 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-4643b3f6-7b11-4a41-95bd-0ea461b2894f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:30.867469 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-4643b3f6-7b11-4a41-95bd-0ea461b2894f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1408 microversion: 2.20 time: 0.423844 Aug 26 15:57:30.868016 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 77/133] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:30 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1408 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:30.877007 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 57/134] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:30 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1363 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:30.882457 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-65991e2e-4b7b-429d-8484-8adf18272b7b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:30.883259 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-65991e2e-4b7b-429d-8484-8adf18272b7b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:30.889878 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-65991e2e-4b7b-429d-8484-8adf18272b7b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:30.890348 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-65991e2e-4b7b-429d-8484-8adf18272b7b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:30.893801 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-65991e2e-4b7b-429d-8484-8adf18272b7b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:30.893801 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-65991e2e-4b7b-429d-8484-8adf18272b7b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:30.893801 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-65991e2e-4b7b-429d-8484-8adf18272b7b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:30.893801 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-65991e2e-4b7b-429d-8484-8adf18272b7b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:31.137357 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-65991e2e-4b7b-429d-8484-8adf18272b7b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:31.145773 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-65991e2e-4b7b-429d-8484-8adf18272b7b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1367 microversion: 2.1 time: 0.276784 Aug 26 15:57:31.146344 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 78/135] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:30 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:31.211351 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-19d4c8e3-3592-4242-8704-90b876ea61ea tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:31.211961 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-19d4c8e3-3592-4242-8704-90b876ea61ea tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:31.214989 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:57:31.219223 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-19d4c8e3-3592-4242-8704-90b876ea61ea tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:31.219713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-19d4c8e3-3592-4242-8704-90b876ea61ea tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:31.220138 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-19d4c8e3-3592-4242-8704-90b876ea61ea tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:31.220826 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-19d4c8e3-3592-4242-8704-90b876ea61ea tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:31.221280 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-19d4c8e3-3592-4242-8704-90b876ea61ea tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:31.221710 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-19d4c8e3-3592-4242-8704-90b876ea61ea tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:31.239338 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-64c6be83-6135-4d08-ba71-301c7cbb121b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:31.239338 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-64c6be83-6135-4d08-ba71-301c7cbb121b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:31.244466 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-64c6be83-6135-4d08-ba71-301c7cbb121b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:31.244951 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-64c6be83-6135-4d08-ba71-301c7cbb121b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:31.245388 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-64c6be83-6135-4d08-ba71-301c7cbb121b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:31.246198 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-64c6be83-6135-4d08-ba71-301c7cbb121b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:31.246664 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-64c6be83-6135-4d08-ba71-301c7cbb121b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:31.247010 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-64c6be83-6135-4d08-ba71-301c7cbb121b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:31.423937 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-19d4c8e3-3592-4242-8704-90b876ea61ea tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:31.432281 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-64c6be83-6135-4d08-ba71-301c7cbb121b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:31.432927 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-19d4c8e3-3592-4242-8704-90b876ea61ea tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1315 microversion: 2.1 time: 0.225326 Aug 26 15:57:31.433842 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 58/136] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:31 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:31.445889 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-64c6be83-6135-4d08-ba71-301c7cbb121b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1517 microversion: 2.1 time: 0.211171 Aug 26 15:57:31.447716 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 79/137] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:31 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1517 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:57:31.472787 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-944139a7-1f28-41d8-af7a-2bae6c95c232 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:57:31.475268 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-944139a7-1f28-41d8-af7a-2bae6c95c232 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:31.481349 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-944139a7-1f28-41d8-af7a-2bae6c95c232 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:31.481837 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-944139a7-1f28-41d8-af7a-2bae6c95c232 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:31.482465 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-944139a7-1f28-41d8-af7a-2bae6c95c232 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:31.483298 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-944139a7-1f28-41d8-af7a-2bae6c95c232 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:31.483755 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-944139a7-1f28-41d8-af7a-2bae6c95c232 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:31.484202 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-944139a7-1f28-41d8-af7a-2bae6c95c232 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:31.547334 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.objects.instance [None req-944139a7-1f28-41d8-af7a-2bae6c95c232 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lazy-loading 'flavor' on Instance uuid c04e0499-9326-4fe8-8e28-80be6b0d7a14 {{(pid=128304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:57:31.886822 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-074371f5-874d-4101-85aa-7dbac15e0674 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:31.887602 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-074371f5-874d-4101-85aa-7dbac15e0674 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:31.895192 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-074371f5-874d-4101-85aa-7dbac15e0674 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:31.895684 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-074371f5-874d-4101-85aa-7dbac15e0674 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:31.896116 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-074371f5-874d-4101-85aa-7dbac15e0674 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:31.896813 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-074371f5-874d-4101-85aa-7dbac15e0674 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:31.897256 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-074371f5-874d-4101-85aa-7dbac15e0674 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:31.915234 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-074371f5-874d-4101-85aa-7dbac15e0674 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:32.088040 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-944139a7-1f28-41d8-af7a-2bae6c95c232 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "POST /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14/action" status: 200 len: 32 microversion: 2.1 time: 0.619288 Aug 26 15:57:32.102823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 59/138] 10.222.0.94 () {60 vars in 1278 bytes} [Fri Aug 26 15:57:31 2022] POST /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14/action => generated 32 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 15:57:32.112082 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-77ce12fe-2120-4389-92cf-222d74fdca3c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:32.112818 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-77ce12fe-2120-4389-92cf-222d74fdca3c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:32.119501 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-77ce12fe-2120-4389-92cf-222d74fdca3c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:32.119990 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-77ce12fe-2120-4389-92cf-222d74fdca3c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:32.120435 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-77ce12fe-2120-4389-92cf-222d74fdca3c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:32.121285 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-77ce12fe-2120-4389-92cf-222d74fdca3c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:32.128031 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-77ce12fe-2120-4389-92cf-222d74fdca3c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:32.128031 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-77ce12fe-2120-4389-92cf-222d74fdca3c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:32.327290 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-074371f5-874d-4101-85aa-7dbac15e0674 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:32.336060 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-074371f5-874d-4101-85aa-7dbac15e0674 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1363 microversion: 2.1 time: 0.455360 Aug 26 15:57:32.342976 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 80/139] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:31 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1363 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:32.342976 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a9bf012a-42ea-410c-a43f-32cf57939185 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:32.343813 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a9bf012a-42ea-410c-a43f-32cf57939185 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:32.350118 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a9bf012a-42ea-410c-a43f-32cf57939185 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:32.350598 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a9bf012a-42ea-410c-a43f-32cf57939185 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:32.351071 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a9bf012a-42ea-410c-a43f-32cf57939185 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:32.355288 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a9bf012a-42ea-410c-a43f-32cf57939185 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:32.355288 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a9bf012a-42ea-410c-a43f-32cf57939185 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:32.355288 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a9bf012a-42ea-410c-a43f-32cf57939185 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:32.376985 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-77ce12fe-2120-4389-92cf-222d74fdca3c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:32.385098 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-77ce12fe-2120-4389-92cf-222d74fdca3c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:32.389633 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-77ce12fe-2120-4389-92cf-222d74fdca3c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:32.389633 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-77ce12fe-2120-4389-92cf-222d74fdca3c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1408 microversion: 2.20 time: 0.283321 Aug 26 15:57:32.389633 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 60/140] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:32 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1408 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:32.393187 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-2aff0029-9835-4ae9-a602-68bc0edf062d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:32.393796 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-2aff0029-9835-4ae9-a602-68bc0edf062d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:32.399799 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2aff0029-9835-4ae9-a602-68bc0edf062d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:32.400345 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2aff0029-9835-4ae9-a602-68bc0edf062d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:32.400784 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2aff0029-9835-4ae9-a602-68bc0edf062d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:32.401524 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2aff0029-9835-4ae9-a602-68bc0edf062d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:32.401974 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2aff0029-9835-4ae9-a602-68bc0edf062d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:32.402396 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2aff0029-9835-4ae9-a602-68bc0edf062d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:32.418338 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:57:32.541334 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a9bf012a-42ea-410c-a43f-32cf57939185 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:32.553685 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a9bf012a-42ea-410c-a43f-32cf57939185 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.214527 Aug 26 15:57:32.556131 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 81/141] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:32 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:32.563036 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-8a3f1423-b5c7-486e-80f0-930a25817f97 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:32.564630 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-8a3f1423-b5c7-486e-80f0-930a25817f97 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:32.572715 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8a3f1423-b5c7-486e-80f0-930a25817f97 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:32.573447 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8a3f1423-b5c7-486e-80f0-930a25817f97 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:32.574546 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8a3f1423-b5c7-486e-80f0-930a25817f97 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:32.576309 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8a3f1423-b5c7-486e-80f0-930a25817f97 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:32.576924 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8a3f1423-b5c7-486e-80f0-930a25817f97 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:32.578092 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8a3f1423-b5c7-486e-80f0-930a25817f97 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:32.579058 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-2aff0029-9835-4ae9-a602-68bc0edf062d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:32.599558 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-2aff0029-9835-4ae9-a602-68bc0edf062d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1367 microversion: 2.1 time: 0.209749 Aug 26 15:57:32.600830 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 61/142] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:32 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:32.740094 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-8a3f1423-b5c7-486e-80f0-930a25817f97 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:32.747814 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-8a3f1423-b5c7-486e-80f0-930a25817f97 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1315 microversion: 2.1 time: 0.189947 Aug 26 15:57:32.748583 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 82/143] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:32 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:32.964970 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-d2255665-d938-41e3-ac0a-387623d6b197 req-24f4fbab-b293-4da7-b787-7f57dd478250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0e476ca-b4b7-4537-bfca-2c66b7246c3e", "name": "network-vif-plugged", "status": "completed", "tag": "51cd4e58-b1f3-4e1f-b212-98868414d616"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:57:32.976069 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-d2255665-d938-41e3-ac0a-387623d6b197 req-24f4fbab-b293-4da7-b787-7f57dd478250 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:32.976543 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-d2255665-d938-41e3-ac0a-387623d6b197 req-24f4fbab-b293-4da7-b787-7f57dd478250 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:32.976988 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-d2255665-d938-41e3-ac0a-387623d6b197 req-24f4fbab-b293-4da7-b787-7f57dd478250 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:32.988632 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-d2255665-d938-41e3-ac0a-387623d6b197 req-24f4fbab-b293-4da7-b787-7f57dd478250 service nova] Creating event network-vif-plugged:51cd4e58-b1f3-4e1f-b212-98868414d616 for instance f0e476ca-b4b7-4537-bfca-2c66b7246c3e on hv-cinder-85144 Aug 26 15:57:32.993569 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-d2255665-d938-41e3-ac0a-387623d6b197 req-24f4fbab-b293-4da7-b787-7f57dd478250 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032197 Aug 26 15:57:32.994309 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 62/144] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 15:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:57:33.357647 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-84e15281-4084-4b00-a888-d9ac5f9d46a2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:33.358154 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-84e15281-4084-4b00-a888-d9ac5f9d46a2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:33.361177 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_api:SELECT=100 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:57:33.364431 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-84e15281-4084-4b00-a888-d9ac5f9d46a2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:33.364906 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-84e15281-4084-4b00-a888-d9ac5f9d46a2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:33.365336 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-84e15281-4084-4b00-a888-d9ac5f9d46a2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:33.366024 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-84e15281-4084-4b00-a888-d9ac5f9d46a2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:33.366467 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-84e15281-4084-4b00-a888-d9ac5f9d46a2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:33.366884 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-84e15281-4084-4b00-a888-d9ac5f9d46a2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:33.410948 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-be8b2fc5-3f5d-4ee3-b4a2-6a5d4ef81d6e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:33.411897 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-be8b2fc5-3f5d-4ee3-b4a2-6a5d4ef81d6e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:33.419156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-be8b2fc5-3f5d-4ee3-b4a2-6a5d4ef81d6e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:33.421938 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-be8b2fc5-3f5d-4ee3-b4a2-6a5d4ef81d6e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:33.421938 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-be8b2fc5-3f5d-4ee3-b4a2-6a5d4ef81d6e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:33.421938 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-be8b2fc5-3f5d-4ee3-b4a2-6a5d4ef81d6e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:33.421938 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-be8b2fc5-3f5d-4ee3-b4a2-6a5d4ef81d6e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:33.422223 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-be8b2fc5-3f5d-4ee3-b4a2-6a5d4ef81d6e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:33.579728 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-84e15281-4084-4b00-a888-d9ac5f9d46a2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:33.587887 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-84e15281-4084-4b00-a888-d9ac5f9d46a2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1363 microversion: 2.1 time: 0.234091 Aug 26 15:57:33.588458 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 83/145] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:33 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:33.604033 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-be8b2fc5-3f5d-4ee3-b4a2-6a5d4ef81d6e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:33.607589 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-0bef79d6-1316-4302-ab11-c0501db1deca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:33.608513 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-0bef79d6-1316-4302-ab11-c0501db1deca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:33.617550 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0bef79d6-1316-4302-ab11-c0501db1deca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:33.618218 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0bef79d6-1316-4302-ab11-c0501db1deca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:33.618396 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-be8b2fc5-3f5d-4ee3-b4a2-6a5d4ef81d6e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:33.618818 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0bef79d6-1316-4302-ab11-c0501db1deca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:33.620071 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-be8b2fc5-3f5d-4ee3-b4a2-6a5d4ef81d6e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:33.620296 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0bef79d6-1316-4302-ab11-c0501db1deca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:33.620763 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0bef79d6-1316-4302-ab11-c0501db1deca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:33.621487 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0bef79d6-1316-4302-ab11-c0501db1deca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:33.621679 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-be8b2fc5-3f5d-4ee3-b4a2-6a5d4ef81d6e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1408 microversion: 2.20 time: 0.214452 Aug 26 15:57:33.622585 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 63/146] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:33 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1408 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:57:33.628139 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-2e29926e-9973-4fc2-b6da-856d71f3ab62 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:33.628941 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-2e29926e-9973-4fc2-b6da-856d71f3ab62 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:33.639855 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2e29926e-9973-4fc2-b6da-856d71f3ab62 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:33.640626 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2e29926e-9973-4fc2-b6da-856d71f3ab62 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:33.641358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2e29926e-9973-4fc2-b6da-856d71f3ab62 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:33.642299 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2e29926e-9973-4fc2-b6da-856d71f3ab62 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:33.644397 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2e29926e-9973-4fc2-b6da-856d71f3ab62 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:33.645108 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2e29926e-9973-4fc2-b6da-856d71f3ab62 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:33.862833 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-0bef79d6-1316-4302-ab11-c0501db1deca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:33.867738 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-0bef79d6-1316-4302-ab11-c0501db1deca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.277785 Aug 26 15:57:33.868570 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 84/147] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:33 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:33.874098 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-14159945-e1e0-477a-a22e-fc4deb0f3e50 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:33.875050 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-14159945-e1e0-477a-a22e-fc4deb0f3e50 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:33.881914 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-14159945-e1e0-477a-a22e-fc4deb0f3e50 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:33.882625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-14159945-e1e0-477a-a22e-fc4deb0f3e50 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:33.883309 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-14159945-e1e0-477a-a22e-fc4deb0f3e50 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:33.884223 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-14159945-e1e0-477a-a22e-fc4deb0f3e50 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:33.884757 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-2e29926e-9973-4fc2-b6da-856d71f3ab62 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:33.884970 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-14159945-e1e0-477a-a22e-fc4deb0f3e50 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:33.885565 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-14159945-e1e0-477a-a22e-fc4deb0f3e50 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:33.908131 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=100 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:57:33.908222 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-2e29926e-9973-4fc2-b6da-856d71f3ab62 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1367 microversion: 2.1 time: 0.270133 Aug 26 15:57:33.908222 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 64/148] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:33 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:34.031275 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-14159945-e1e0-477a-a22e-fc4deb0f3e50 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:34.039028 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-14159945-e1e0-477a-a22e-fc4deb0f3e50 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1315 microversion: 2.1 time: 0.169018 Aug 26 15:57:34.040441 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 85/149] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:33 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:34.609575 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-0b94d0f4-539e-4e21-8011-93a5388a5938 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:34.610187 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-0b94d0f4-539e-4e21-8011-93a5388a5938 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:34.616451 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0b94d0f4-539e-4e21-8011-93a5388a5938 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:34.616930 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0b94d0f4-539e-4e21-8011-93a5388a5938 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:34.617384 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0b94d0f4-539e-4e21-8011-93a5388a5938 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:34.622404 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0b94d0f4-539e-4e21-8011-93a5388a5938 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:34.622404 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0b94d0f4-539e-4e21-8011-93a5388a5938 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:34.622404 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0b94d0f4-539e-4e21-8011-93a5388a5938 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:34.659601 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-aafc230d-c23d-4eef-b9d1-3bbb2e715e20 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:34.659601 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-aafc230d-c23d-4eef-b9d1-3bbb2e715e20 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:34.665528 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-aafc230d-c23d-4eef-b9d1-3bbb2e715e20 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:34.666148 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-aafc230d-c23d-4eef-b9d1-3bbb2e715e20 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:34.666755 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-aafc230d-c23d-4eef-b9d1-3bbb2e715e20 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:34.667766 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-aafc230d-c23d-4eef-b9d1-3bbb2e715e20 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:34.668342 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-aafc230d-c23d-4eef-b9d1-3bbb2e715e20 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:34.668896 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-aafc230d-c23d-4eef-b9d1-3bbb2e715e20 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:34.875686 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-0b94d0f4-539e-4e21-8011-93a5388a5938 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:34.889140 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-0b94d0f4-539e-4e21-8011-93a5388a5938 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1363 microversion: 2.1 time: 0.283345 Aug 26 15:57:34.902996 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 65/150] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:34 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1363 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:34.914091 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-e86f00bf-2d37-42b8-b0ec-e7b9c6e28143 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:34.914634 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-e86f00bf-2d37-42b8-b0ec-e7b9c6e28143 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:34.925528 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e86f00bf-2d37-42b8-b0ec-e7b9c6e28143 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:34.926675 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e86f00bf-2d37-42b8-b0ec-e7b9c6e28143 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:34.933015 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e86f00bf-2d37-42b8-b0ec-e7b9c6e28143 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:34.933015 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e86f00bf-2d37-42b8-b0ec-e7b9c6e28143 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:34.933015 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e86f00bf-2d37-42b8-b0ec-e7b9c6e28143 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:34.933015 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e86f00bf-2d37-42b8-b0ec-e7b9c6e28143 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:35.023689 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-aafc230d-c23d-4eef-b9d1-3bbb2e715e20 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:35.032638 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-aafc230d-c23d-4eef-b9d1-3bbb2e715e20 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:35.034089 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-aafc230d-c23d-4eef-b9d1-3bbb2e715e20 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:35.035221 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-aafc230d-c23d-4eef-b9d1-3bbb2e715e20 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1408 microversion: 2.20 time: 0.390627 Aug 26 15:57:35.035779 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 86/151] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:34 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1408 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:57:35.043595 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-8f258635-99f0-4bbe-a32a-9f5fb1cb953a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:35.044782 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-8f258635-99f0-4bbe-a32a-9f5fb1cb953a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:35.051547 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8f258635-99f0-4bbe-a32a-9f5fb1cb953a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:35.052716 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8f258635-99f0-4bbe-a32a-9f5fb1cb953a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:35.053168 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8f258635-99f0-4bbe-a32a-9f5fb1cb953a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:35.053872 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8f258635-99f0-4bbe-a32a-9f5fb1cb953a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:35.054331 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8f258635-99f0-4bbe-a32a-9f5fb1cb953a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:35.054760 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8f258635-99f0-4bbe-a32a-9f5fb1cb953a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:35.099302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell0:SELECT=2 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:57:35.109387 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e86f00bf-2d37-42b8-b0ec-e7b9c6e28143 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:35.117290 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-e86f00bf-2d37-42b8-b0ec-e7b9c6e28143 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.210886 Aug 26 15:57:35.118185 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 66/152] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:34 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:35.124926 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-0b9dac2e-8de4-40c7-a3eb-a361f3bf9aa2 req-d1fd04a9-72b4-4df1-8545-4a05a74b1d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac977a7-aa08-459a-a863-36ba667422d1", "name": "network-vif-plugged", "status": "completed", "tag": "8a53b00a-319e-4368-a0b0-216d2f508b1d"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:57:35.140976 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-0b9dac2e-8de4-40c7-a3eb-a361f3bf9aa2 req-d1fd04a9-72b4-4df1-8545-4a05a74b1d42 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:35.141619 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-0b9dac2e-8de4-40c7-a3eb-a361f3bf9aa2 req-d1fd04a9-72b4-4df1-8545-4a05a74b1d42 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:35.142155 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-0b9dac2e-8de4-40c7-a3eb-a361f3bf9aa2 req-d1fd04a9-72b4-4df1-8545-4a05a74b1d42 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:35.165786 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-0b9dac2e-8de4-40c7-a3eb-a361f3bf9aa2 req-d1fd04a9-72b4-4df1-8545-4a05a74b1d42 service nova] Creating event network-vif-plugged:8a53b00a-319e-4368-a0b0-216d2f508b1d for instance 8ac977a7-aa08-459a-a863-36ba667422d1 on hv-cinder-85144 Aug 26 15:57:35.172477 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-0b9dac2e-8de4-40c7-a3eb-a361f3bf9aa2 req-d1fd04a9-72b4-4df1-8545-4a05a74b1d42 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052933 Aug 26 15:57:35.174090 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 67/153] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 15:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:57:35.180963 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-45f5be98-a13d-46d7-af25-480bfd4290ad tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:35.181965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-45f5be98-a13d-46d7-af25-480bfd4290ad tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:35.192393 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-45f5be98-a13d-46d7-af25-480bfd4290ad tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:35.194474 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-45f5be98-a13d-46d7-af25-480bfd4290ad tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:35.194474 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-45f5be98-a13d-46d7-af25-480bfd4290ad tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:35.194474 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-45f5be98-a13d-46d7-af25-480bfd4290ad tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:35.194703 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-45f5be98-a13d-46d7-af25-480bfd4290ad tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:35.195177 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-45f5be98-a13d-46d7-af25-480bfd4290ad tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:35.224278 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-8f258635-99f0-4bbe-a32a-9f5fb1cb953a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:35.235089 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-8f258635-99f0-4bbe-a32a-9f5fb1cb953a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1556 microversion: 2.1 time: 0.198265 Aug 26 15:57:35.235725 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 87/154] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:35 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1556 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:35.260209 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-0af20004-8624-419d-a068-5c92bf693727 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:35.260705 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-0af20004-8624-419d-a068-5c92bf693727 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:35.267875 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0af20004-8624-419d-a068-5c92bf693727 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:35.268356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0af20004-8624-419d-a068-5c92bf693727 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:35.268781 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0af20004-8624-419d-a068-5c92bf693727 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:35.269772 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0af20004-8624-419d-a068-5c92bf693727 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:35.270537 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0af20004-8624-419d-a068-5c92bf693727 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:35.271291 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0af20004-8624-419d-a068-5c92bf693727 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:35.349980 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-45f5be98-a13d-46d7-af25-480bfd4290ad tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:35.360636 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-45f5be98-a13d-46d7-af25-480bfd4290ad tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1315 microversion: 2.1 time: 0.184134 Aug 26 15:57:35.361993 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 68/155] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:35 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:35.421247 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-0af20004-8624-419d-a068-5c92bf693727 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.165763 Aug 26 15:57:35.422181 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 88/156] 10.222.0.94 () {58 vars in 1275 bytes} [Fri Aug 26 15:57:35 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a/os-interface => generated 284 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:57:35.913758 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7bdb7f6f-cffb-43b7-bc00-7cf0556f33b4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:35.915607 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-7bdb7f6f-cffb-43b7-bc00-7cf0556f33b4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:35.922916 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7bdb7f6f-cffb-43b7-bc00-7cf0556f33b4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:35.923712 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7bdb7f6f-cffb-43b7-bc00-7cf0556f33b4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:35.924158 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7bdb7f6f-cffb-43b7-bc00-7cf0556f33b4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:35.924875 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7bdb7f6f-cffb-43b7-bc00-7cf0556f33b4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:35.925332 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7bdb7f6f-cffb-43b7-bc00-7cf0556f33b4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:35.925755 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7bdb7f6f-cffb-43b7-bc00-7cf0556f33b4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:36.058228 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-97b3e575-e215-4cb1-86b9-c4651736ab60 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:36.058827 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-97b3e575-e215-4cb1-86b9-c4651736ab60 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:36.068768 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-97b3e575-e215-4cb1-86b9-c4651736ab60 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:36.068768 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-97b3e575-e215-4cb1-86b9-c4651736ab60 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:36.068768 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-97b3e575-e215-4cb1-86b9-c4651736ab60 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:36.068768 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-97b3e575-e215-4cb1-86b9-c4651736ab60 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:36.071831 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-97b3e575-e215-4cb1-86b9-c4651736ab60 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:36.071831 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-97b3e575-e215-4cb1-86b9-c4651736ab60 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:36.492322 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7bdb7f6f-cffb-43b7-bc00-7cf0556f33b4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:36.501544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-7bdb7f6f-cffb-43b7-bc00-7cf0556f33b4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1363 microversion: 2.1 time: 0.591687 Aug 26 15:57:36.502450 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 69/157] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:35 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1363 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:36.507301 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-1605cd52-52c2-458b-bfdd-547b2f94afd7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:36.507992 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-1605cd52-52c2-458b-bfdd-547b2f94afd7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:36.515106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1605cd52-52c2-458b-bfdd-547b2f94afd7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:36.515674 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1605cd52-52c2-458b-bfdd-547b2f94afd7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:36.516815 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1605cd52-52c2-458b-bfdd-547b2f94afd7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:36.517939 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1605cd52-52c2-458b-bfdd-547b2f94afd7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:36.518493 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1605cd52-52c2-458b-bfdd-547b2f94afd7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:36.519158 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1605cd52-52c2-458b-bfdd-547b2f94afd7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:36.614551 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-97b3e575-e215-4cb1-86b9-c4651736ab60 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:36.626122 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-97b3e575-e215-4cb1-86b9-c4651736ab60 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:36.627693 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-97b3e575-e215-4cb1-86b9-c4651736ab60 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:36.651795 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-97b3e575-e215-4cb1-86b9-c4651736ab60 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1408 microversion: 2.20 time: 0.575030 Aug 26 15:57:36.651795 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 89/158] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:36 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1408 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:57:36.651795 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-02ddc7d3-f4a1-4278-9359-c711e3d57656 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:36.651795 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-02ddc7d3-f4a1-4278-9359-c711e3d57656 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:36.651795 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-02ddc7d3-f4a1-4278-9359-c711e3d57656 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:36.652405 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-02ddc7d3-f4a1-4278-9359-c711e3d57656 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:36.652405 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-02ddc7d3-f4a1-4278-9359-c711e3d57656 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:36.652405 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-02ddc7d3-f4a1-4278-9359-c711e3d57656 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:36.652405 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-02ddc7d3-f4a1-4278-9359-c711e3d57656 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:36.653180 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-02ddc7d3-f4a1-4278-9359-c711e3d57656 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:36.721105 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-1605cd52-52c2-458b-bfdd-547b2f94afd7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:36.729385 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-1605cd52-52c2-458b-bfdd-547b2f94afd7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.225594 Aug 26 15:57:36.729935 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 70/159] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:36 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:36.961584 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-02ddc7d3-f4a1-4278-9359-c711e3d57656 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:36.969753 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-02ddc7d3-f4a1-4278-9359-c711e3d57656 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1501 microversion: 2.1 time: 0.339207 Aug 26 15:57:36.970703 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 90/160] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:36 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1501 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:37.369743 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-7ab08226-4e81-4d17-b99e-21f0e14758dd req-e38a5e9b-ec44-49de-880d-875ba63373bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6103553d-b9c7-4ab7-aef1-3fd676bb0a8a", "tag": "c3d450c2-3d49-40aa-b88c-475438ac1fcc"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:57:37.384631 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-7ab08226-4e81-4d17-b99e-21f0e14758dd req-e38a5e9b-ec44-49de-880d-875ba63373bc service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:37.385127 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-7ab08226-4e81-4d17-b99e-21f0e14758dd req-e38a5e9b-ec44-49de-880d-875ba63373bc service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:37.386328 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-7ab08226-4e81-4d17-b99e-21f0e14758dd req-e38a5e9b-ec44-49de-880d-875ba63373bc service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:37.401934 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-7ab08226-4e81-4d17-b99e-21f0e14758dd req-e38a5e9b-ec44-49de-880d-875ba63373bc service nova] Creating event network-changed:c3d450c2-3d49-40aa-b88c-475438ac1fcc for instance 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a on hv-cinder-85144 Aug 26 15:57:37.412527 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-7ab08226-4e81-4d17-b99e-21f0e14758dd req-e38a5e9b-ec44-49de-880d-875ba63373bc service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046355 Aug 26 15:57:37.413130 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 71/161] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 15:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:57:37.524287 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-fa187c09-3563-4a0b-bdc4-42be797ff0f1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:37.525724 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-fa187c09-3563-4a0b-bdc4-42be797ff0f1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:37.532440 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fa187c09-3563-4a0b-bdc4-42be797ff0f1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:37.533157 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fa187c09-3563-4a0b-bdc4-42be797ff0f1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:37.533768 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fa187c09-3563-4a0b-bdc4-42be797ff0f1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:37.534668 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fa187c09-3563-4a0b-bdc4-42be797ff0f1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:37.535319 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fa187c09-3563-4a0b-bdc4-42be797ff0f1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:37.535951 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fa187c09-3563-4a0b-bdc4-42be797ff0f1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:37.664366 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ce558ced-a1ec-439e-a1f3-ae2c6f925465 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:37.665247 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ce558ced-a1ec-439e-a1f3-ae2c6f925465 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:37.672334 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ce558ced-a1ec-439e-a1f3-ae2c6f925465 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:37.672846 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ce558ced-a1ec-439e-a1f3-ae2c6f925465 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:37.673624 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ce558ced-a1ec-439e-a1f3-ae2c6f925465 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:37.674107 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ce558ced-a1ec-439e-a1f3-ae2c6f925465 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:37.674677 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ce558ced-a1ec-439e-a1f3-ae2c6f925465 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:37.675967 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ce558ced-a1ec-439e-a1f3-ae2c6f925465 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:37.688651 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-fa187c09-3563-4a0b-bdc4-42be797ff0f1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:37.700140 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-fa187c09-3563-4a0b-bdc4-42be797ff0f1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1363 microversion: 2.1 time: 0.180209 Aug 26 15:57:37.715505 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 91/162] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:37 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:37.750994 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-ad27a2c6-3804-48a0-8f4a-0fa194f02c8c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:37.751901 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-ad27a2c6-3804-48a0-8f4a-0fa194f02c8c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:37.758080 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ad27a2c6-3804-48a0-8f4a-0fa194f02c8c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:37.758798 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ad27a2c6-3804-48a0-8f4a-0fa194f02c8c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:37.759486 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ad27a2c6-3804-48a0-8f4a-0fa194f02c8c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:37.760690 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ad27a2c6-3804-48a0-8f4a-0fa194f02c8c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:37.761760 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ad27a2c6-3804-48a0-8f4a-0fa194f02c8c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:37.762192 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ad27a2c6-3804-48a0-8f4a-0fa194f02c8c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:37.974969 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-ce558ced-a1ec-439e-a1f3-ae2c6f925465 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:37.984326 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-ce558ced-a1ec-439e-a1f3-ae2c6f925465 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:37.985780 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-ce558ced-a1ec-439e-a1f3-ae2c6f925465 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:37.986901 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ce558ced-a1ec-439e-a1f3-ae2c6f925465 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1408 microversion: 2.20 time: 0.326966 Aug 26 15:57:38.001381 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 72/163] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:37 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1408 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:38.117062 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-ad27a2c6-3804-48a0-8f4a-0fa194f02c8c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:38.125488 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-ad27a2c6-3804-48a0-8f4a-0fa194f02c8c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.379628 Aug 26 15:57:38.130788 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 92/164] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:37 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:57:38.721913 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-845c6941-c766-4c08-b084-e87724dc1753 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:38.722523 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-845c6941-c766-4c08-b084-e87724dc1753 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:38.729111 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-845c6941-c766-4c08-b084-e87724dc1753 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:38.729603 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-845c6941-c766-4c08-b084-e87724dc1753 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:38.730047 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-845c6941-c766-4c08-b084-e87724dc1753 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:38.730757 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-845c6941-c766-4c08-b084-e87724dc1753 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:38.731407 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-845c6941-c766-4c08-b084-e87724dc1753 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:38.732056 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-845c6941-c766-4c08-b084-e87724dc1753 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:38.910577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-845c6941-c766-4c08-b084-e87724dc1753 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:38.923379 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-845c6941-c766-4c08-b084-e87724dc1753 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1363 microversion: 2.1 time: 0.205156 Aug 26 15:57:38.924119 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 73/165] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:38 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:39.014223 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a791027b-256b-48f5-8e7d-9bc45010b4dc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:39.015648 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a791027b-256b-48f5-8e7d-9bc45010b4dc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:39.022734 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a791027b-256b-48f5-8e7d-9bc45010b4dc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:39.023316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a791027b-256b-48f5-8e7d-9bc45010b4dc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:39.023815 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a791027b-256b-48f5-8e7d-9bc45010b4dc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:39.024590 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a791027b-256b-48f5-8e7d-9bc45010b4dc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:39.025115 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a791027b-256b-48f5-8e7d-9bc45010b4dc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:39.025607 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a791027b-256b-48f5-8e7d-9bc45010b4dc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:39.152023 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-1dce6193-3841-4430-9449-fa129078bfcd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:39.152702 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-1dce6193-3841-4430-9449-fa129078bfcd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:39.160723 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1dce6193-3841-4430-9449-fa129078bfcd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:39.161490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1dce6193-3841-4430-9449-fa129078bfcd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:39.161945 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1dce6193-3841-4430-9449-fa129078bfcd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:39.162649 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1dce6193-3841-4430-9449-fa129078bfcd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:39.163745 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1dce6193-3841-4430-9449-fa129078bfcd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:39.164201 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1dce6193-3841-4430-9449-fa129078bfcd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:39.297752 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a791027b-256b-48f5-8e7d-9bc45010b4dc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:39.308227 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a791027b-256b-48f5-8e7d-9bc45010b4dc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:39.310140 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a791027b-256b-48f5-8e7d-9bc45010b4dc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:39.310140 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a791027b-256b-48f5-8e7d-9bc45010b4dc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1408 microversion: 2.20 time: 0.300824 Aug 26 15:57:39.310663 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 93/166] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:39 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1408 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:39.356700 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-1dce6193-3841-4430-9449-fa129078bfcd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:39.366702 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-1dce6193-3841-4430-9449-fa129078bfcd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.218710 Aug 26 15:57:39.379041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 74/167] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:39 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:57:39.945639 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-53f17f4c-6937-4c77-84d2-4281cbd7979d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:39.946321 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-53f17f4c-6937-4c77-84d2-4281cbd7979d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:39.952896 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-53f17f4c-6937-4c77-84d2-4281cbd7979d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:39.953380 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-53f17f4c-6937-4c77-84d2-4281cbd7979d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:39.953810 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-53f17f4c-6937-4c77-84d2-4281cbd7979d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:39.954495 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-53f17f4c-6937-4c77-84d2-4281cbd7979d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:39.954960 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-53f17f4c-6937-4c77-84d2-4281cbd7979d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:39.955389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-53f17f4c-6937-4c77-84d2-4281cbd7979d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:40.204337 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-5d61e3d9-2a3b-4618-b8c7-22a4288cf417 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33c162a0-cc16-44e6-abb2-379fa6bfa6b2"}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:57:40.206682 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-5d61e3d9-2a3b-4618-b8c7-22a4288cf417 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:40.216088 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d61e3d9-2a3b-4618-b8c7-22a4288cf417 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:40.218293 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d61e3d9-2a3b-4618-b8c7-22a4288cf417 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:40.220792 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d61e3d9-2a3b-4618-b8c7-22a4288cf417 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:40.221548 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d61e3d9-2a3b-4618-b8c7-22a4288cf417 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:40.222062 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d61e3d9-2a3b-4618-b8c7-22a4288cf417 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:40.222485 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d61e3d9-2a3b-4618-b8c7-22a4288cf417 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:40.234016 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-53f17f4c-6937-4c77-84d2-4281cbd7979d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:40.243643 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-53f17f4c-6937-4c77-84d2-4281cbd7979d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1549 microversion: 2.1 time: 0.301650 Aug 26 15:57:40.244081 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 94/168] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:39 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1549 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:40.269285 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-1a787dc0-40ed-432e-b40a-fd630e15a235 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:40.270396 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-1a787dc0-40ed-432e-b40a-fd630e15a235 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:40.284151 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1a787dc0-40ed-432e-b40a-fd630e15a235 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:40.284810 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1a787dc0-40ed-432e-b40a-fd630e15a235 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:40.285259 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1a787dc0-40ed-432e-b40a-fd630e15a235 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:40.285971 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1a787dc0-40ed-432e-b40a-fd630e15a235 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:40.286602 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1a787dc0-40ed-432e-b40a-fd630e15a235 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:40.287254 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1a787dc0-40ed-432e-b40a-fd630e15a235 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:40.404743 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-1a787dc0-40ed-432e-b40a-fd630e15a235 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.138748 Aug 26 15:57:40.411836 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 95/169] 10.222.0.94 () {58 vars in 1275 bytes} [Fri Aug 26 15:57:40 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e/os-interface => generated 285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:57:40.411836 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-2e09ed0d-3cfd-47a5-bd53-4dfc3cf852cb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:40.411836 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-2e09ed0d-3cfd-47a5-bd53-4dfc3cf852cb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:40.417377 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2e09ed0d-3cfd-47a5-bd53-4dfc3cf852cb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:40.417872 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2e09ed0d-3cfd-47a5-bd53-4dfc3cf852cb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:40.418308 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2e09ed0d-3cfd-47a5-bd53-4dfc3cf852cb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:40.419087 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2e09ed0d-3cfd-47a5-bd53-4dfc3cf852cb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:40.419803 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2e09ed0d-3cfd-47a5-bd53-4dfc3cf852cb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:40.420367 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2e09ed0d-3cfd-47a5-bd53-4dfc3cf852cb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:40.704892 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-2e09ed0d-3cfd-47a5-bd53-4dfc3cf852cb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:40.713473 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-2e09ed0d-3cfd-47a5-bd53-4dfc3cf852cb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:40.717314 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-2e09ed0d-3cfd-47a5-bd53-4dfc3cf852cb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:40.718778 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-2e09ed0d-3cfd-47a5-bd53-4dfc3cf852cb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1408 microversion: 2.20 time: 0.312196 Aug 26 15:57:40.719580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 96/170] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:40 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1408 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:57:40.732271 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-15ad501e-4519-48a2-9ed9-d20ca6a0c37c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:40.733505 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-15ad501e-4519-48a2-9ed9-d20ca6a0c37c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:40.739885 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-15ad501e-4519-48a2-9ed9-d20ca6a0c37c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:40.740506 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-15ad501e-4519-48a2-9ed9-d20ca6a0c37c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:40.741216 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-15ad501e-4519-48a2-9ed9-d20ca6a0c37c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:40.742014 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-15ad501e-4519-48a2-9ed9-d20ca6a0c37c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:40.742519 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-15ad501e-4519-48a2-9ed9-d20ca6a0c37c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:40.743145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-15ad501e-4519-48a2-9ed9-d20ca6a0c37c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:40.967867 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-15ad501e-4519-48a2-9ed9-d20ca6a0c37c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:40.979343 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-15ad501e-4519-48a2-9ed9-d20ca6a0c37c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.258492 Aug 26 15:57:40.981184 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 97/171] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:40 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:41.741703 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-c072303f-cf65-4283-b953-1b7cf9b92b6a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:41.742358 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-c072303f-cf65-4283-b953-1b7cf9b92b6a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:41.754188 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c072303f-cf65-4283-b953-1b7cf9b92b6a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:41.754678 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c072303f-cf65-4283-b953-1b7cf9b92b6a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:41.757024 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c072303f-cf65-4283-b953-1b7cf9b92b6a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:41.757024 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c072303f-cf65-4283-b953-1b7cf9b92b6a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:41.757024 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c072303f-cf65-4283-b953-1b7cf9b92b6a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:41.757024 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c072303f-cf65-4283-b953-1b7cf9b92b6a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:41.898641 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-5d61e3d9-2a3b-4618-b8c7-22a4288cf417 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "POST /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.699001 Aug 26 15:57:41.901542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 75/172] 10.222.0.94 () {60 vars in 1323 bytes} [Fri Aug 26 15:57:40 2022] POST /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf/os-volume_attachments => generated 194 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:57:41.934159 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-c072303f-cf65-4283-b953-1b7cf9b92b6a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:41.949946 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-c072303f-cf65-4283-b953-1b7cf9b92b6a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:41.952723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-c072303f-cf65-4283-b953-1b7cf9b92b6a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:41.956855 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-c072303f-cf65-4283-b953-1b7cf9b92b6a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1600 microversion: 2.20 time: 0.219197 Aug 26 15:57:41.957840 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 98/173] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:57:41 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1600 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:57:41.983639 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-bf93a7be-3e6d-46ad-b052-e973973ae5bc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:41.984027 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-bf93a7be-3e6d-46ad-b052-e973973ae5bc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:41.991589 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bf93a7be-3e6d-46ad-b052-e973973ae5bc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:41.992075 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bf93a7be-3e6d-46ad-b052-e973973ae5bc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:41.992506 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bf93a7be-3e6d-46ad-b052-e973973ae5bc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:41.993205 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bf93a7be-3e6d-46ad-b052-e973973ae5bc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:41.994413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bf93a7be-3e6d-46ad-b052-e973973ae5bc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:41.995019 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bf93a7be-3e6d-46ad-b052-e973973ae5bc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:42.002377 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-d55fd28c-337f-4792-8c21-e5f2fe3f7c17 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:42.009078 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-d55fd28c-337f-4792-8c21-e5f2fe3f7c17 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:42.019699 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d55fd28c-337f-4792-8c21-e5f2fe3f7c17 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:42.021946 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d55fd28c-337f-4792-8c21-e5f2fe3f7c17 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:42.022875 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d55fd28c-337f-4792-8c21-e5f2fe3f7c17 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:42.024417 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d55fd28c-337f-4792-8c21-e5f2fe3f7c17 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:42.027123 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d55fd28c-337f-4792-8c21-e5f2fe3f7c17 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:42.027920 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d55fd28c-337f-4792-8c21-e5f2fe3f7c17 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:42.114840 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-bf93a7be-3e6d-46ad-b052-e973973ae5bc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.136270 Aug 26 15:57:42.114840 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 76/174] 10.222.0.94 () {60 vars in 1316 bytes} [Fri Aug 26 15:57:41 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1/os-interface => generated 285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:57:42.120053 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-6c2a8541-f1dd-4336-97c1-795ed1f376da req-cbc0ca1c-1f7c-444f-875d-b0fdd27fb34f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0e476ca-b4b7-4537-bfca-2c66b7246c3e", "tag": "51cd4e58-b1f3-4e1f-b212-98868414d616"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:57:42.131726 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-6c2a8541-f1dd-4336-97c1-795ed1f376da req-cbc0ca1c-1f7c-444f-875d-b0fdd27fb34f service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:42.132216 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-6c2a8541-f1dd-4336-97c1-795ed1f376da req-cbc0ca1c-1f7c-444f-875d-b0fdd27fb34f service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:42.132777 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-6c2a8541-f1dd-4336-97c1-795ed1f376da req-cbc0ca1c-1f7c-444f-875d-b0fdd27fb34f service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:42.146075 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-6c2a8541-f1dd-4336-97c1-795ed1f376da req-cbc0ca1c-1f7c-444f-875d-b0fdd27fb34f service nova] Creating event network-changed:51cd4e58-b1f3-4e1f-b212-98868414d616 for instance f0e476ca-b4b7-4537-bfca-2c66b7246c3e on hv-cinder-85144 Aug 26 15:57:42.151988 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-6c2a8541-f1dd-4336-97c1-795ed1f376da req-cbc0ca1c-1f7c-444f-875d-b0fdd27fb34f service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036452 Aug 26 15:57:42.152905 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 77/175] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 15:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:57:42.247240 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d55fd28c-337f-4792-8c21-e5f2fe3f7c17 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:42.259935 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-d55fd28c-337f-4792-8c21-e5f2fe3f7c17 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.261645 Aug 26 15:57:42.261107 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 99/176] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:41 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:57:43.282443 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-6ab9af9a-88a9-4be5-a170-12a47c715981 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:43.283862 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-6ab9af9a-88a9-4be5-a170-12a47c715981 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:43.292298 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ab9af9a-88a9-4be5-a170-12a47c715981 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:43.293006 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ab9af9a-88a9-4be5-a170-12a47c715981 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:43.294499 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ab9af9a-88a9-4be5-a170-12a47c715981 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:43.295595 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ab9af9a-88a9-4be5-a170-12a47c715981 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:43.296282 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ab9af9a-88a9-4be5-a170-12a47c715981 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:43.296807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ab9af9a-88a9-4be5-a170-12a47c715981 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:43.476728 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-6ab9af9a-88a9-4be5-a170-12a47c715981 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:43.487110 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-6ab9af9a-88a9-4be5-a170-12a47c715981 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.209803 Aug 26 15:57:43.487806 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 78/177] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:43 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:44.177201 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-666ada56-3cf9-4fed-8750-9231a0560ccd req-4cac39db-12fb-495b-a9fa-718681a80c1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ac977a7-aa08-459a-a863-36ba667422d1", "tag": "8a53b00a-319e-4368-a0b0-216d2f508b1d"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:57:44.187772 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-666ada56-3cf9-4fed-8750-9231a0560ccd req-4cac39db-12fb-495b-a9fa-718681a80c1b service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:44.188246 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-666ada56-3cf9-4fed-8750-9231a0560ccd req-4cac39db-12fb-495b-a9fa-718681a80c1b service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:44.188679 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-666ada56-3cf9-4fed-8750-9231a0560ccd req-4cac39db-12fb-495b-a9fa-718681a80c1b service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:44.199844 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-666ada56-3cf9-4fed-8750-9231a0560ccd req-4cac39db-12fb-495b-a9fa-718681a80c1b service nova] Creating event network-changed:8a53b00a-319e-4368-a0b0-216d2f508b1d for instance 8ac977a7-aa08-459a-a863-36ba667422d1 on hv-cinder-85144 Aug 26 15:57:44.205973 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-666ada56-3cf9-4fed-8750-9231a0560ccd req-4cac39db-12fb-495b-a9fa-718681a80c1b service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032258 Aug 26 15:57:44.207268 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 100/178] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 15:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:57:44.508727 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-62d264bf-e2fa-4b7d-b7be-8314acf7e820 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:44.509351 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-62d264bf-e2fa-4b7d-b7be-8314acf7e820 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:44.519107 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-62d264bf-e2fa-4b7d-b7be-8314acf7e820 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:44.519658 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-62d264bf-e2fa-4b7d-b7be-8314acf7e820 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:44.520326 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-62d264bf-e2fa-4b7d-b7be-8314acf7e820 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:44.524219 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-62d264bf-e2fa-4b7d-b7be-8314acf7e820 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:44.524219 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-62d264bf-e2fa-4b7d-b7be-8314acf7e820 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:44.524219 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-62d264bf-e2fa-4b7d-b7be-8314acf7e820 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:44.866029 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-62d264bf-e2fa-4b7d-b7be-8314acf7e820 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:44.868714 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:57:44.879734 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-62d264bf-e2fa-4b7d-b7be-8314acf7e820 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.374812 Aug 26 15:57:44.892229 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 79/179] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:44 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:45.901773 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-1b52bc8e-80df-4d74-922e-104e30ac418c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:45.902602 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-1b52bc8e-80df-4d74-922e-104e30ac418c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:45.908851 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1b52bc8e-80df-4d74-922e-104e30ac418c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:45.909332 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1b52bc8e-80df-4d74-922e-104e30ac418c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:45.909766 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1b52bc8e-80df-4d74-922e-104e30ac418c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:45.910454 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1b52bc8e-80df-4d74-922e-104e30ac418c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:45.910906 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1b52bc8e-80df-4d74-922e-104e30ac418c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:45.911355 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1b52bc8e-80df-4d74-922e-104e30ac418c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:46.066314 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-1b52bc8e-80df-4d74-922e-104e30ac418c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:46.079012 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-1b52bc8e-80df-4d74-922e-104e30ac418c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.181221 Aug 26 15:57:46.091234 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 101/180] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:45 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:47.103055 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-d28f305f-a48e-447b-a60b-032c3a65e01e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:47.112188 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-d28f305f-a48e-447b-a60b-032c3a65e01e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:47.112655 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d28f305f-a48e-447b-a60b-032c3a65e01e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:47.113291 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d28f305f-a48e-447b-a60b-032c3a65e01e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:47.113880 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d28f305f-a48e-447b-a60b-032c3a65e01e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:47.114733 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d28f305f-a48e-447b-a60b-032c3a65e01e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:47.115527 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d28f305f-a48e-447b-a60b-032c3a65e01e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:47.116094 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d28f305f-a48e-447b-a60b-032c3a65e01e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:47.254279 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-d28f305f-a48e-447b-a60b-032c3a65e01e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:47.262371 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-d28f305f-a48e-447b-a60b-032c3a65e01e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.163051 Aug 26 15:57:47.263761 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 80/181] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:47 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:48.286126 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-9e66d898-f9e1-4fac-8048-bc2b9c107102 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:48.286126 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-9e66d898-f9e1-4fac-8048-bc2b9c107102 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:48.292402 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9e66d898-f9e1-4fac-8048-bc2b9c107102 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:48.292890 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9e66d898-f9e1-4fac-8048-bc2b9c107102 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:48.293743 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9e66d898-f9e1-4fac-8048-bc2b9c107102 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:48.294217 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9e66d898-f9e1-4fac-8048-bc2b9c107102 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:48.294607 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9e66d898-f9e1-4fac-8048-bc2b9c107102 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:48.295165 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9e66d898-f9e1-4fac-8048-bc2b9c107102 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:48.440470 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-9e66d898-f9e1-4fac-8048-bc2b9c107102 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:48.448163 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-9e66d898-f9e1-4fac-8048-bc2b9c107102 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.167716 Aug 26 15:57:48.448727 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 102/182] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:48 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:49.472029 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-4a0b958b-2b38-4b51-a530-3c3e85811d3e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:49.472905 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-4a0b958b-2b38-4b51-a530-3c3e85811d3e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:49.484844 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4a0b958b-2b38-4b51-a530-3c3e85811d3e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:49.485622 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4a0b958b-2b38-4b51-a530-3c3e85811d3e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:49.486351 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4a0b958b-2b38-4b51-a530-3c3e85811d3e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:49.487338 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4a0b958b-2b38-4b51-a530-3c3e85811d3e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:49.488028 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4a0b958b-2b38-4b51-a530-3c3e85811d3e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:49.488692 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4a0b958b-2b38-4b51-a530-3c3e85811d3e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:49.630021 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-4a0b958b-2b38-4b51-a530-3c3e85811d3e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:49.638535 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-4a0b958b-2b38-4b51-a530-3c3e85811d3e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.172670 Aug 26 15:57:49.639226 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 81/183] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:49 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:50.665926 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-fbb3c501-0d8d-4967-ba5c-2e1fdfde6904 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:50.667710 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-fbb3c501-0d8d-4967-ba5c-2e1fdfde6904 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:50.674963 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fbb3c501-0d8d-4967-ba5c-2e1fdfde6904 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:50.675610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fbb3c501-0d8d-4967-ba5c-2e1fdfde6904 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:50.676047 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fbb3c501-0d8d-4967-ba5c-2e1fdfde6904 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:50.676729 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fbb3c501-0d8d-4967-ba5c-2e1fdfde6904 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:50.677261 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fbb3c501-0d8d-4967-ba5c-2e1fdfde6904 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:50.677684 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fbb3c501-0d8d-4967-ba5c-2e1fdfde6904 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:50.682045 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=100 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:57:50.815743 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-fbb3c501-0d8d-4967-ba5c-2e1fdfde6904 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:50.823506 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-fbb3c501-0d8d-4967-ba5c-2e1fdfde6904 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.168140 Aug 26 15:57:50.824261 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 103/184] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:50 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:51.851721 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-c60cad55-972a-4328-88cf-34e399747b25 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:51.852334 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-c60cad55-972a-4328-88cf-34e399747b25 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:51.858939 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c60cad55-972a-4328-88cf-34e399747b25 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:51.859425 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c60cad55-972a-4328-88cf-34e399747b25 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:51.859858 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c60cad55-972a-4328-88cf-34e399747b25 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:51.860615 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c60cad55-972a-4328-88cf-34e399747b25 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:51.860994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c60cad55-972a-4328-88cf-34e399747b25 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:51.861415 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c60cad55-972a-4328-88cf-34e399747b25 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:52.015888 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-c60cad55-972a-4328-88cf-34e399747b25 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:52.015888 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-c60cad55-972a-4328-88cf-34e399747b25 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.154103 Aug 26 15:57:52.015888 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 82/185] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:51 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:53.023323 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-9d692d56-4455-46c9-9379-ef8ec9a18174 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:53.024095 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-9d692d56-4455-46c9-9379-ef8ec9a18174 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:53.032912 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9d692d56-4455-46c9-9379-ef8ec9a18174 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:53.033699 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9d692d56-4455-46c9-9379-ef8ec9a18174 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:53.034369 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9d692d56-4455-46c9-9379-ef8ec9a18174 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:53.035523 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9d692d56-4455-46c9-9379-ef8ec9a18174 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:53.036323 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9d692d56-4455-46c9-9379-ef8ec9a18174 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:53.036876 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9d692d56-4455-46c9-9379-ef8ec9a18174 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:53.190472 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-9d692d56-4455-46c9-9379-ef8ec9a18174 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:53.207654 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-9d692d56-4455-46c9-9379-ef8ec9a18174 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.189309 Aug 26 15:57:53.209738 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 104/186] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:53 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:54.234364 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-d063669a-5c81-44b9-9b11-e6d3546dfc61 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:54.234998 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-d063669a-5c81-44b9-9b11-e6d3546dfc61 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:54.241767 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d063669a-5c81-44b9-9b11-e6d3546dfc61 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:54.242242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d063669a-5c81-44b9-9b11-e6d3546dfc61 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:54.242733 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d063669a-5c81-44b9-9b11-e6d3546dfc61 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:54.243446 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d063669a-5c81-44b9-9b11-e6d3546dfc61 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:54.243896 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d063669a-5c81-44b9-9b11-e6d3546dfc61 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:54.244316 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d063669a-5c81-44b9-9b11-e6d3546dfc61 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:54.373158 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-d063669a-5c81-44b9-9b11-e6d3546dfc61 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:54.381003 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-d063669a-5c81-44b9-9b11-e6d3546dfc61 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.150661 Aug 26 15:57:54.381619 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 83/187] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:54 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:57:54.635791 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-14588f8d-bdf3-4b0b-beb3-eab32fdf52bb tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:54.636316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-14588f8d-bdf3-4b0b-beb3-eab32fdf52bb tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:54.642356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-14588f8d-bdf3-4b0b-beb3-eab32fdf52bb tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:54.642837 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-14588f8d-bdf3-4b0b-beb3-eab32fdf52bb tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:54.643328 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-14588f8d-bdf3-4b0b-beb3-eab32fdf52bb tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:54.646694 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-14588f8d-bdf3-4b0b-beb3-eab32fdf52bb tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:54.646694 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-14588f8d-bdf3-4b0b-beb3-eab32fdf52bb tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:54.646694 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-14588f8d-bdf3-4b0b-beb3-eab32fdf52bb tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:54.670766 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-14588f8d-bdf3-4b0b-beb3-eab32fdf52bb tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Going to try to terminate instance {{(pid=128305) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 15:57:55.032508 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-14588f8d-bdf3-4b0b-beb3-eab32fdf52bb tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "DELETE /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 204 len: 0 microversion: 2.1 time: 0.400294 Aug 26 15:57:55.033323 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 105/188] 10.222.0.94 () {58 vars in 1239 bytes} [Fri Aug 26 15:57:54 2022] DELETE /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 15:57:55.042109 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-6ac74ea5-5430-418a-b745-95fd952295a2 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:55.042669 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-6ac74ea5-5430-418a-b745-95fd952295a2 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:55.049760 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ac74ea5-5430-418a-b745-95fd952295a2 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:55.050238 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ac74ea5-5430-418a-b745-95fd952295a2 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:55.050678 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ac74ea5-5430-418a-b745-95fd952295a2 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:55.051409 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ac74ea5-5430-418a-b745-95fd952295a2 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:55.051860 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ac74ea5-5430-418a-b745-95fd952295a2 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:55.052319 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ac74ea5-5430-418a-b745-95fd952295a2 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:55.240792 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-6ac74ea5-5430-418a-b745-95fd952295a2 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:55.250522 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-6ac74ea5-5430-418a-b745-95fd952295a2 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1553 microversion: 2.1 time: 0.212317 Aug 26 15:57:55.251344 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 84/189] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:55 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1553 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:55.403818 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-56dc356d-6a9a-468f-aaa0-f21bda9aefbd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:55.404638 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-56dc356d-6a9a-468f-aaa0-f21bda9aefbd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:55.410465 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-56dc356d-6a9a-468f-aaa0-f21bda9aefbd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:55.411915 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-56dc356d-6a9a-468f-aaa0-f21bda9aefbd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:55.411915 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-56dc356d-6a9a-468f-aaa0-f21bda9aefbd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:55.412120 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-56dc356d-6a9a-468f-aaa0-f21bda9aefbd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:55.412504 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-56dc356d-6a9a-468f-aaa0-f21bda9aefbd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:55.412921 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-56dc356d-6a9a-468f-aaa0-f21bda9aefbd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:55.547851 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-56dc356d-6a9a-468f-aaa0-f21bda9aefbd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:55.555506 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-56dc356d-6a9a-468f-aaa0-f21bda9aefbd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.156530 Aug 26 15:57:55.556095 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 106/190] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:55 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:56.272585 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-927834aa-2e55-4004-978c-fe21e028400c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:56.273404 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-927834aa-2e55-4004-978c-fe21e028400c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:56.281475 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-927834aa-2e55-4004-978c-fe21e028400c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:56.282129 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-927834aa-2e55-4004-978c-fe21e028400c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:56.282744 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-927834aa-2e55-4004-978c-fe21e028400c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:56.283456 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-927834aa-2e55-4004-978c-fe21e028400c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:56.283981 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-927834aa-2e55-4004-978c-fe21e028400c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:56.284476 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-927834aa-2e55-4004-978c-fe21e028400c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:56.425510 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-927834aa-2e55-4004-978c-fe21e028400c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:56.433833 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-927834aa-2e55-4004-978c-fe21e028400c tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1553 microversion: 2.1 time: 0.165495 Aug 26 15:57:56.435143 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 85/191] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:56 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:56.577390 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-6471d29c-986a-4881-befe-021e5f87ef55 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:56.578794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-6471d29c-986a-4881-befe-021e5f87ef55 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:56.587732 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6471d29c-986a-4881-befe-021e5f87ef55 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:56.587732 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6471d29c-986a-4881-befe-021e5f87ef55 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:56.587732 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6471d29c-986a-4881-befe-021e5f87ef55 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:56.587732 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6471d29c-986a-4881-befe-021e5f87ef55 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:56.588187 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6471d29c-986a-4881-befe-021e5f87ef55 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:56.588187 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6471d29c-986a-4881-befe-021e5f87ef55 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:56.717849 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-6471d29c-986a-4881-befe-021e5f87ef55 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:56.725575 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-6471d29c-986a-4881-befe-021e5f87ef55 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.153214 Aug 26 15:57:56.726140 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 107/192] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:56 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:57.456829 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-4f8464c5-eaeb-4b1b-8c9b-f40830e6f4fa tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:57.457595 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-4f8464c5-eaeb-4b1b-8c9b-f40830e6f4fa tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:57.465042 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4f8464c5-eaeb-4b1b-8c9b-f40830e6f4fa tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:57.465894 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4f8464c5-eaeb-4b1b-8c9b-f40830e6f4fa tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:57.466551 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4f8464c5-eaeb-4b1b-8c9b-f40830e6f4fa tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:57.467533 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4f8464c5-eaeb-4b1b-8c9b-f40830e6f4fa tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:57.468241 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4f8464c5-eaeb-4b1b-8c9b-f40830e6f4fa tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:57.468824 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4f8464c5-eaeb-4b1b-8c9b-f40830e6f4fa tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:57.636374 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-4f8464c5-eaeb-4b1b-8c9b-f40830e6f4fa tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:57.644790 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-4f8464c5-eaeb-4b1b-8c9b-f40830e6f4fa tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1553 microversion: 2.1 time: 0.191956 Aug 26 15:57:57.645407 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 86/193] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:57 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1553 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:57.747679 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-ebd5e0e8-e21b-4f8c-80e8-44607b32f451 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:57.748507 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-ebd5e0e8-e21b-4f8c-80e8-44607b32f451 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:57.754503 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ebd5e0e8-e21b-4f8c-80e8-44607b32f451 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:57.755005 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ebd5e0e8-e21b-4f8c-80e8-44607b32f451 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:57.755431 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ebd5e0e8-e21b-4f8c-80e8-44607b32f451 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:57.756146 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ebd5e0e8-e21b-4f8c-80e8-44607b32f451 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:57.756587 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ebd5e0e8-e21b-4f8c-80e8-44607b32f451 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:57.757498 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ebd5e0e8-e21b-4f8c-80e8-44607b32f451 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:57.893791 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-ebd5e0e8-e21b-4f8c-80e8-44607b32f451 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:57.901449 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-ebd5e0e8-e21b-4f8c-80e8-44607b32f451 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.158422 Aug 26 15:57:57.902005 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 108/194] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:57 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:58.667279 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-b3818419-64ce-4334-8573-207cc74c0a28 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:58.667909 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-b3818419-64ce-4334-8573-207cc74c0a28 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:58.675892 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b3818419-64ce-4334-8573-207cc74c0a28 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:58.676579 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b3818419-64ce-4334-8573-207cc74c0a28 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:58.677181 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b3818419-64ce-4334-8573-207cc74c0a28 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:58.678019 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b3818419-64ce-4334-8573-207cc74c0a28 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:58.678773 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b3818419-64ce-4334-8573-207cc74c0a28 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:58.679397 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b3818419-64ce-4334-8573-207cc74c0a28 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:58.890613 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-b3818419-64ce-4334-8573-207cc74c0a28 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:58.904420 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-b3818419-64ce-4334-8573-207cc74c0a28 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1553 microversion: 2.1 time: 0.240609 Aug 26 15:57:58.905956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 87/195] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:58 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1553 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:58.924262 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-910d4334-9d39-4536-9048-8189008ba663 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:58.924863 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-910d4334-9d39-4536-9048-8189008ba663 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:58.931275 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-910d4334-9d39-4536-9048-8189008ba663 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:58.931751 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-910d4334-9d39-4536-9048-8189008ba663 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:58.932178 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-910d4334-9d39-4536-9048-8189008ba663 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:58.932917 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-910d4334-9d39-4536-9048-8189008ba663 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:58.933335 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-910d4334-9d39-4536-9048-8189008ba663 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:58.933717 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-910d4334-9d39-4536-9048-8189008ba663 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:59.136481 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-0cb9e1f8-0cbf-459b-8ff0-fb71304ffcb2 req-4793cbba-6719-4ea9-a875-958aa061f54a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4425d401-9f5d-4aa8-a568-35ee9cd768bf", "name": "network-vif-deleted", "tag": "7e519cd9-1a52-4518-a7ed-6455ad985b10"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:57:59.147855 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-0cb9e1f8-0cbf-459b-8ff0-fb71304ffcb2 req-4793cbba-6719-4ea9-a875-958aa061f54a service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:59.148329 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-0cb9e1f8-0cbf-459b-8ff0-fb71304ffcb2 req-4793cbba-6719-4ea9-a875-958aa061f54a service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:59.148753 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-0cb9e1f8-0cbf-459b-8ff0-fb71304ffcb2 req-4793cbba-6719-4ea9-a875-958aa061f54a service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:59.177777 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-0cb9e1f8-0cbf-459b-8ff0-fb71304ffcb2 req-4793cbba-6719-4ea9-a875-958aa061f54a service nova] Creating event network-vif-deleted:7e519cd9-1a52-4518-a7ed-6455ad985b10 for instance 4425d401-9f5d-4aa8-a568-35ee9cd768bf on hv-cinder-85144 Aug 26 15:57:59.187498 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-0cb9e1f8-0cbf-459b-8ff0-fb71304ffcb2 req-4793cbba-6719-4ea9-a875-958aa061f54a service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054641 Aug 26 15:57:59.189373 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 88/196] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 15:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:57:59.265471 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-910d4334-9d39-4536-9048-8189008ba663 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:57:59.282883 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-910d4334-9d39-4536-9048-8189008ba663 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.362865 Aug 26 15:57:59.284152 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 109/197] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:58 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:57:59.929401 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-0f34e937-3a43-4fc6-8dce-d99496c838ec tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:57:59.929401 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-0f34e937-3a43-4fc6-8dce-d99496c838ec tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:57:59.936613 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f34e937-3a43-4fc6-8dce-d99496c838ec tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:59.937326 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f34e937-3a43-4fc6-8dce-d99496c838ec tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:59.937773 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f34e937-3a43-4fc6-8dce-d99496c838ec tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:57:59.938485 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f34e937-3a43-4fc6-8dce-d99496c838ec tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:57:59.938964 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f34e937-3a43-4fc6-8dce-d99496c838ec tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:57:59.939628 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f34e937-3a43-4fc6-8dce-d99496c838ec tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:00.026789 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-0f34e937-3a43-4fc6-8dce-d99496c838ec tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:00.037314 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-0f34e937-3a43-4fc6-8dce-d99496c838ec tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1346 microversion: 2.1 time: 0.114989 Aug 26 15:58:00.038144 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 89/198] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:57:59 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1346 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:00.304308 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-cc831964-15af-4a94-b70e-ebf3c29b8297 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:00.304915 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-cc831964-15af-4a94-b70e-ebf3c29b8297 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:00.311507 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cc831964-15af-4a94-b70e-ebf3c29b8297 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:00.311990 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cc831964-15af-4a94-b70e-ebf3c29b8297 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:00.312597 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cc831964-15af-4a94-b70e-ebf3c29b8297 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:00.314652 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cc831964-15af-4a94-b70e-ebf3c29b8297 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:00.314652 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cc831964-15af-4a94-b70e-ebf3c29b8297 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:00.314652 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cc831964-15af-4a94-b70e-ebf3c29b8297 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:00.448546 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-cc831964-15af-4a94-b70e-ebf3c29b8297 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:00.456715 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-cc831964-15af-4a94-b70e-ebf3c29b8297 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.156315 Aug 26 15:58:00.457305 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 110/199] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:00 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:01.060956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-8e5bbd51-0992-43f9-a40e-6661d8d021b2 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:01.061573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-8e5bbd51-0992-43f9-a40e-6661d8d021b2 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:01.081436 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8e5bbd51-0992-43f9-a40e-6661d8d021b2 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:01.081935 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8e5bbd51-0992-43f9-a40e-6661d8d021b2 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:01.082377 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8e5bbd51-0992-43f9-a40e-6661d8d021b2 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:01.083129 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8e5bbd51-0992-43f9-a40e-6661d8d021b2 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:01.083579 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8e5bbd51-0992-43f9-a40e-6661d8d021b2 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:01.084011 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8e5bbd51-0992-43f9-a40e-6661d8d021b2 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:01.126848 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8e5bbd51-0992-43f9-a40e-6661d8d021b2 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:01.126848 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8e5bbd51-0992-43f9-a40e-6661d8d021b2 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:01.126848 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8e5bbd51-0992-43f9-a40e-6661d8d021b2 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:01.126848 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.objects.instance [None req-8e5bbd51-0992-43f9-a40e-6661d8d021b2 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lazy-loading 'fault' on Instance uuid 4425d401-9f5d-4aa8-a568-35ee9cd768bf {{(pid=128304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:58:01.176473 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-8e5bbd51-0992-43f9-a40e-6661d8d021b2 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56fcb6b073d4f1d9dabab1e0bac6ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e649b58115ab4bcbbf045a3c036a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:01.185036 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-8e5bbd51-0992-43f9-a40e-6661d8d021b2 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 200 len: 1351 microversion: 2.1 time: 0.128332 Aug 26 15:58:01.185611 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 90/200] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:01 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 1351 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:01.478166 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-c82f5efe-a409-4878-a049-e0258337c7bf tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:01.478866 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-c82f5efe-a409-4878-a049-e0258337c7bf tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:01.485360 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c82f5efe-a409-4878-a049-e0258337c7bf tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:01.485879 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c82f5efe-a409-4878-a049-e0258337c7bf tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:01.486313 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c82f5efe-a409-4878-a049-e0258337c7bf tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:01.487044 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c82f5efe-a409-4878-a049-e0258337c7bf tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:01.487497 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c82f5efe-a409-4878-a049-e0258337c7bf tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:01.487919 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c82f5efe-a409-4878-a049-e0258337c7bf tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:01.619461 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-c82f5efe-a409-4878-a049-e0258337c7bf tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:01.627401 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-c82f5efe-a409-4878-a049-e0258337c7bf tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.153479 Aug 26 15:58:01.627946 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 111/201] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:01 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:02.049421 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-44379993-7f5e-4e1f-b8da-2b36e9a35499 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-208456260", "imageRef": "bcbdbb0c-7335-4427-a636-e2dc730274b6", "flavorRef": "452", "networks": [{"uuid": "896b40d0-f5e7-4bb6-9611-c340591fa457"}]}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:58:02.104066 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.network.neutron [None req-44379993-7f5e-4e1f-b8da-2b36e9a35499 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] validate_networks() for [('896b40d0-f5e7-4bb6-9611-c340591fa457', None, None, None, None, None)] {{(pid=128304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:58:02.205923 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-65d42ba8-0bb3-4410-9188-d9ba43d2e203 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:02.206514 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-65d42ba8-0bb3-4410-9188-d9ba43d2e203 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:02.212376 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-65d42ba8-0bb3-4410-9188-d9ba43d2e203 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:02.213021 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-65d42ba8-0bb3-4410-9188-d9ba43d2e203 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:02.213448 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-65d42ba8-0bb3-4410-9188-d9ba43d2e203 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:02.214122 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-65d42ba8-0bb3-4410-9188-d9ba43d2e203 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:02.214562 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-65d42ba8-0bb3-4410-9188-d9ba43d2e203 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:02.215080 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-65d42ba8-0bb3-4410-9188-d9ba43d2e203 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:02.230131 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.wsgi [None req-65d42ba8-0bb3-4410-9188-d9ba43d2e203 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] HTTP exception thrown: Instance 4425d401-9f5d-4aa8-a568-35ee9cd768bf could not be found. Aug 26 15:58:02.235682 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-65d42ba8-0bb3-4410-9188-d9ba43d2e203 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Request method failure captured: Aug 26 15:58:02.235682 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: request: GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf HTTP/1.1 Aug 26 15:58:02.235682 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept: application/json Aug 26 15:58:02.235682 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept-Encoding: identity Aug 26 15:58:02.235682 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Connection: close Aug 26 15:58:02.235682 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Length: 0 Aug 26 15:58:02.235682 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Type: application/json Aug 26 15:58:02.235682 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Host: 10.222.0.94 Aug 26 15:58:02.235682 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Openstack-System-Scope: None Aug 26 15:58:02.235682 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: User-Agent: python-urllib3/1.26.11 Aug 26 15:58:02.235682 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Auth-Token: gAAAAABjCO1E7kQhm-satQaN6C0OftN-FnRQIZPQwemFrXNphHMtr8xe9G_BeoAVQFHMQattW-bjCTS1YwyhSOwdBxfKdZvJDd4WKTiJaK2zp-3JPcZpYrwXiaWPUX2Y2LCzJdIP1Mu1LklBTodqZAJc8WB-FKTiIwH1WLmCTjrlMv4wCWuAQ0U Aug 26 15:58:02.235682 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Id: None Aug 26 15:58:02.235682 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Name: None Aug 26 15:58:02.235682 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Identity-Status: Confirmed Aug 26 15:58:02.235682 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Is-Admin-Project: True Aug 26 15:58:02.235682 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Id: default Aug 26 15:58:02.235682 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Name: Default Aug 26 15:58:02.235682 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Id: e649b58115ab4bcbbf045a3c036a3049 Aug 26 15:58:02.235682 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Name: tempest-DeleteServersTestJSON-97909677 Aug 26 15:58:02.235682 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Role: member,reader Aug 26 15:58:02.235682 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Roles: member,reader Aug 26 15:58:02.237104 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/e649b58115ab4bcbbf045a3c036a3049"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/e649b58115ab4bcbbf045a3c036a3049"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/e649b58115ab4bcbbf045a3c036a3049"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_e649b58115ab4bcbbf045a3c036a3049", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 15:58:02.237104 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant: tempest-DeleteServersTestJSON-97909677 Aug 26 15:58:02.237104 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Id: e649b58115ab4bcbbf045a3c036a3049 Aug 26 15:58:02.237104 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Name: tempest-DeleteServersTestJSON-97909677 Aug 26 15:58:02.237104 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User: tempest-DeleteServersTestJSON-97909677-project Aug 26 15:58:02.237104 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Id: default Aug 26 15:58:02.237104 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Name: Default Aug 26 15:58:02.237104 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Id: f56fcb6b073d4f1d9dabab1e0bac6ec3 Aug 26 15:58:02.237104 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Name: tempest-DeleteServersTestJSON-97909677-project Aug 26 15:58:02.237104 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: method: > Aug 26 15:58:02.237104 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: exception: Instance 4425d401-9f5d-4aa8-a568-35ee9cd768bf could not be found. Aug 26 15:58:02.237104 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: action_args: {'id': '4425d401-9f5d-4aa8-a568-35ee9cd768bf'} Aug 26 15:58:02.237904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:58:02.237904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:02.237904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:58:02.237904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:58:02.237904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:58:02.237904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:58:02.237904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:58:02.237904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:58:02.237904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:58:02.237904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:58:02.237904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4425d401-9f5d-4aa8-a568-35ee9cd768bf could not be found. Aug 26 15:58:02.237904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 15:58:02.237904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:02.237904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 15:58:02.237904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:02.237904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:02.237904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:02.237904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:58:02.237904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:58:02.237904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:58:02.239267 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:58:02.239267 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 15:58:02.239267 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 15:58:02.239267 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:58:02.239267 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:58:02.239267 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:58:02.239267 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:58:02.239267 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4425d401-9f5d-4aa8-a568-35ee9cd768bf could not be found. Aug 26 15:58:02.239267 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 15:58:02.239267 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:02.239267 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 15:58:02.239267 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:02.239267 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:02.239267 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:02.239267 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:58:02.239267 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:58:02.239267 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4425d401-9f5d-4aa8-a568-35ee9cd768bf could not be found. Aug 26 15:58:02.239267 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 15:58:02.240635 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-65d42ba8-0bb3-4410-9188-d9ba43d2e203 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Returning 404 to user: Instance 4425d401-9f5d-4aa8-a568-35ee9cd768bf could not be found. {{(pid=128305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:58:02.240635 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-65d42ba8-0bb3-4410-9188-d9ba43d2e203 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 404 len: 111 microversion: 2.1 time: 0.035558 Aug 26 15:58:02.240635 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 112/202] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:02 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 15:58:02.352416 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-ad210e34-369c-4aa1-9cdb-89100279d341 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:02.354582 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-ad210e34-369c-4aa1-9cdb-89100279d341 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:02.362018 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ad210e34-369c-4aa1-9cdb-89100279d341 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:02.362501 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ad210e34-369c-4aa1-9cdb-89100279d341 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:02.362959 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ad210e34-369c-4aa1-9cdb-89100279d341 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:02.363663 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ad210e34-369c-4aa1-9cdb-89100279d341 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:02.364115 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ad210e34-369c-4aa1-9cdb-89100279d341 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:02.364536 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ad210e34-369c-4aa1-9cdb-89100279d341 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:02.377670 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.wsgi [None req-ad210e34-369c-4aa1-9cdb-89100279d341 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] HTTP exception thrown: Instance 4425d401-9f5d-4aa8-a568-35ee9cd768bf could not be found. Aug 26 15:58:02.379853 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-ad210e34-369c-4aa1-9cdb-89100279d341 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Request method failure captured: Aug 26 15:58:02.379853 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: request: GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf/os-volume_attachments HTTP/1.1 Aug 26 15:58:02.379853 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept: application/json Aug 26 15:58:02.379853 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept-Encoding: identity Aug 26 15:58:02.379853 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Connection: close Aug 26 15:58:02.379853 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Length: 0 Aug 26 15:58:02.379853 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Type: application/json Aug 26 15:58:02.379853 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Host: 10.222.0.94 Aug 26 15:58:02.379853 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Openstack-System-Scope: None Aug 26 15:58:02.379853 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: User-Agent: python-urllib3/1.26.11 Aug 26 15:58:02.379853 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Auth-Token: gAAAAABjCO1E7kQhm-satQaN6C0OftN-FnRQIZPQwemFrXNphHMtr8xe9G_BeoAVQFHMQattW-bjCTS1YwyhSOwdBxfKdZvJDd4WKTiJaK2zp-3JPcZpYrwXiaWPUX2Y2LCzJdIP1Mu1LklBTodqZAJc8WB-FKTiIwH1WLmCTjrlMv4wCWuAQ0U Aug 26 15:58:02.379853 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Id: None Aug 26 15:58:02.379853 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Name: None Aug 26 15:58:02.379853 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Identity-Status: Confirmed Aug 26 15:58:02.379853 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Is-Admin-Project: True Aug 26 15:58:02.379853 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Id: default Aug 26 15:58:02.379853 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Name: Default Aug 26 15:58:02.379853 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Id: e649b58115ab4bcbbf045a3c036a3049 Aug 26 15:58:02.379853 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Name: tempest-DeleteServersTestJSON-97909677 Aug 26 15:58:02.379853 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Role: member,reader Aug 26 15:58:02.379853 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Roles: member,reader Aug 26 15:58:02.381288 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/e649b58115ab4bcbbf045a3c036a3049"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/e649b58115ab4bcbbf045a3c036a3049"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/e649b58115ab4bcbbf045a3c036a3049"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_e649b58115ab4bcbbf045a3c036a3049", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 15:58:02.381288 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant: tempest-DeleteServersTestJSON-97909677 Aug 26 15:58:02.381288 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Id: e649b58115ab4bcbbf045a3c036a3049 Aug 26 15:58:02.381288 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Name: tempest-DeleteServersTestJSON-97909677 Aug 26 15:58:02.381288 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User: tempest-DeleteServersTestJSON-97909677-project Aug 26 15:58:02.381288 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Id: default Aug 26 15:58:02.381288 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Name: Default Aug 26 15:58:02.381288 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Id: f56fcb6b073d4f1d9dabab1e0bac6ec3 Aug 26 15:58:02.381288 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Name: tempest-DeleteServersTestJSON-97909677-project Aug 26 15:58:02.381288 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: method: > Aug 26 15:58:02.381288 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: exception: Instance 4425d401-9f5d-4aa8-a568-35ee9cd768bf could not be found. Aug 26 15:58:02.381288 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: action_args: {'server_id': '4425d401-9f5d-4aa8-a568-35ee9cd768bf'} Aug 26 15:58:02.382061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:58:02.382061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:02.382061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:58:02.382061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:58:02.382061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:58:02.382061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:58:02.382061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:58:02.382061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:58:02.382061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:58:02.382061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:58:02.382061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4425d401-9f5d-4aa8-a568-35ee9cd768bf could not be found. Aug 26 15:58:02.382061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 15:58:02.382061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:02.382061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 15:58:02.382061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:02.382061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:02.382061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:02.382061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:58:02.382061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:58:02.382061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:58:02.383277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:58:02.383277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 26 15:58:02.383277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 15:58:02.383277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 26 15:58:02.383277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 15:58:02.383277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 26 15:58:02.383277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 26 15:58:02.383277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:58:02.383277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:58:02.383277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4425d401-9f5d-4aa8-a568-35ee9cd768bf could not be found. Aug 26 15:58:02.383277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 15:58:02.383277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:02.383277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 15:58:02.383277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:02.383277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:02.383277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:02.383277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:58:02.383277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:58:02.383277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4425d401-9f5d-4aa8-a568-35ee9cd768bf could not be found. Aug 26 15:58:02.383277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 15:58:02.384358 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-ad210e34-369c-4aa1-9cdb-89100279d341 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Returning 404 to user: Instance 4425d401-9f5d-4aa8-a568-35ee9cd768bf could not be found. {{(pid=128305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:58:02.384358 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-ad210e34-369c-4aa1-9cdb-89100279d341 tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032903 Aug 26 15:58:02.384358 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 113/203] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 15:58:02 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 15:58:02.494296 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-44379993-7f5e-4e1f-b8da-2b36e9a35499 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Flavor limits 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:58:02.494715 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-44379993-7f5e-4e1f-b8da-2b36e9a35499 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Image limits 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:58:02.497415 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-44379993-7f5e-4e1f-b8da-2b36e9a35499 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Flavor pref 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:58:02.497415 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-44379993-7f5e-4e1f-b8da-2b36e9a35499 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Image pref 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:58:02.497415 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-44379993-7f5e-4e1f-b8da-2b36e9a35499 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:58:02.499034 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_api:SELECT=69 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:02.506508 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-44379993-7f5e-4e1f-b8da-2b36e9a35499 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:02.507047 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-44379993-7f5e-4e1f-b8da-2b36e9a35499 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:02.507478 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-44379993-7f5e-4e1f-b8da-2b36e9a35499 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:02.508196 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-44379993-7f5e-4e1f-b8da-2b36e9a35499 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:02.508642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-44379993-7f5e-4e1f-b8da-2b36e9a35499 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:02.509134 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-44379993-7f5e-4e1f-b8da-2b36e9a35499 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:02.526457 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-44379993-7f5e-4e1f-b8da-2b36e9a35499 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Getting quotas for project 2ff1702cbe6d41b196df47d78f148368. Resources: {'instances', 'ram', 'cores'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:58:02.530552 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-44379993-7f5e-4e1f-b8da-2b36e9a35499 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Getting quotas for user abe845d55b4b4ac898556dbdc264c086 and project 2ff1702cbe6d41b196df47d78f148368. Resources: {'instances', 'ram', 'cores'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:58:02.541299 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-44379993-7f5e-4e1f-b8da-2b36e9a35499 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Going to run 1 instances... {{(pid=128304) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:58:02.543613 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-44379993-7f5e-4e1f-b8da-2b36e9a35499 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 2ca57bbc-68ea-4114-a936-36f8ef102682] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bcbdbb0c-7335-4427-a636-e2dc730274b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:58:02.648856 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-f0cd327c-8797-45b3-ba4b-7da8ff265c81 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:02.649705 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-f0cd327c-8797-45b3-ba4b-7da8ff265c81 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:02.656027 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f0cd327c-8797-45b3-ba4b-7da8ff265c81 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:02.656509 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f0cd327c-8797-45b3-ba4b-7da8ff265c81 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:02.656945 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f0cd327c-8797-45b3-ba4b-7da8ff265c81 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:02.657635 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f0cd327c-8797-45b3-ba4b-7da8ff265c81 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:02.658086 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f0cd327c-8797-45b3-ba4b-7da8ff265c81 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:02.658511 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f0cd327c-8797-45b3-ba4b-7da8ff265c81 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:02.768895 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-44379993-7f5e-4e1f-b8da-2b36e9a35499 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723335 Aug 26 15:58:02.769551 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 91/204] 10.222.0.94 () {60 vars in 1147 bytes} [Fri Aug 26 15:58:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 15:58:02.780452 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-d211ba65-fe71-4b08-9e29-dd5ecd8af5cc tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:02.781054 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-d211ba65-fe71-4b08-9e29-dd5ecd8af5cc tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 2ca57bbc-68ea-4114-a936-36f8ef102682] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:02.802602 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-f0cd327c-8797-45b3-ba4b-7da8ff265c81 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:02.811448 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-f0cd327c-8797-45b3-ba4b-7da8ff265c81 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.166518 Aug 26 15:58:02.816395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 114/205] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:02 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:02.850093 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-d211ba65-fe71-4b08-9e29-dd5ecd8af5cc tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:02.857752 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-d211ba65-fe71-4b08-9e29-dd5ecd8af5cc tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682" status: 200 len: 1213 microversion: 2.1 time: 0.081300 Aug 26 15:58:02.858327 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 92/206] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:02 2022] GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:03.837932 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-7f5692b9-4f2b-4fe2-9680-ed57b02eaae4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:03.838538 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-7f5692b9-4f2b-4fe2-9680-ed57b02eaae4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:03.841468 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:03.846324 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7f5692b9-4f2b-4fe2-9680-ed57b02eaae4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:03.846816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7f5692b9-4f2b-4fe2-9680-ed57b02eaae4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:03.847289 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7f5692b9-4f2b-4fe2-9680-ed57b02eaae4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:03.847989 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7f5692b9-4f2b-4fe2-9680-ed57b02eaae4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:03.848444 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7f5692b9-4f2b-4fe2-9680-ed57b02eaae4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:03.848866 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7f5692b9-4f2b-4fe2-9680-ed57b02eaae4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:03.878357 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-34b0c915-3679-40d7-9fd3-07a3a61439be tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:03.879011 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-34b0c915-3679-40d7-9fd3-07a3a61439be tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 2ca57bbc-68ea-4114-a936-36f8ef102682] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:03.954452 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-34b0c915-3679-40d7-9fd3-07a3a61439be tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:03.961484 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-34b0c915-3679-40d7-9fd3-07a3a61439be tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682" status: 200 len: 1213 microversion: 2.1 time: 0.086868 Aug 26 15:58:03.962050 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 93/207] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:03 2022] GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:04.016121 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-7f5692b9-4f2b-4fe2-9680-ed57b02eaae4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:04.025379 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-7f5692b9-4f2b-4fe2-9680-ed57b02eaae4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.191420 Aug 26 15:58:04.025953 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 115/208] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:03 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:04.999537 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-5c319fa6-27fe-449e-8a97-a4035db9d130 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:04.999537 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-5c319fa6-27fe-449e-8a97-a4035db9d130 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 2ca57bbc-68ea-4114-a936-36f8ef102682] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:05.003359 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5c319fa6-27fe-449e-8a97-a4035db9d130 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:05.003565 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5c319fa6-27fe-449e-8a97-a4035db9d130 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:05.003994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5c319fa6-27fe-449e-8a97-a4035db9d130 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:05.004681 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5c319fa6-27fe-449e-8a97-a4035db9d130 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:05.005127 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5c319fa6-27fe-449e-8a97-a4035db9d130 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:05.005543 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5c319fa6-27fe-449e-8a97-a4035db9d130 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:05.047556 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-b76a285d-0748-427d-a39e-0adbf0f62d9a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:05.048164 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-b76a285d-0748-427d-a39e-0adbf0f62d9a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:05.054103 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b76a285d-0748-427d-a39e-0adbf0f62d9a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:05.054575 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b76a285d-0748-427d-a39e-0adbf0f62d9a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:05.055026 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b76a285d-0748-427d-a39e-0adbf0f62d9a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:05.055708 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b76a285d-0748-427d-a39e-0adbf0f62d9a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:05.056152 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b76a285d-0748-427d-a39e-0adbf0f62d9a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:05.056619 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b76a285d-0748-427d-a39e-0adbf0f62d9a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:05.066523 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-5c319fa6-27fe-449e-8a97-a4035db9d130 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:05.074161 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-5c319fa6-27fe-449e-8a97-a4035db9d130 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682" status: 200 len: 1217 microversion: 2.1 time: 0.093700 Aug 26 15:58:05.075306 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 94/209] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:04 2022] GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682 => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:05.188042 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b76a285d-0748-427d-a39e-0adbf0f62d9a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:05.195675 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-b76a285d-0748-427d-a39e-0adbf0f62d9a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.152681 Aug 26 15:58:05.196242 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 116/210] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:05 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:06.095193 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7f82760b-8fe3-4ab3-9c87-3222a9f6c8f6 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:06.095795 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-7f82760b-8fe3-4ab3-9c87-3222a9f6c8f6 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 2ca57bbc-68ea-4114-a936-36f8ef102682] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:06.102062 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7f82760b-8fe3-4ab3-9c87-3222a9f6c8f6 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:06.102580 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7f82760b-8fe3-4ab3-9c87-3222a9f6c8f6 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:06.103041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7f82760b-8fe3-4ab3-9c87-3222a9f6c8f6 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:06.103740 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7f82760b-8fe3-4ab3-9c87-3222a9f6c8f6 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:06.104167 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7f82760b-8fe3-4ab3-9c87-3222a9f6c8f6 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:06.107620 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7f82760b-8fe3-4ab3-9c87-3222a9f6c8f6 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:06.165397 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7f82760b-8fe3-4ab3-9c87-3222a9f6c8f6 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:06.172997 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-7f82760b-8fe3-4ab3-9c87-3222a9f6c8f6 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682" status: 200 len: 1217 microversion: 2.1 time: 0.081643 Aug 26 15:58:06.173779 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 95/211] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:06 2022] GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:06.218506 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-3d319290-fda8-48a1-964e-dbbf5aae9b13 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:06.219157 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-3d319290-fda8-48a1-964e-dbbf5aae9b13 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:06.225120 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3d319290-fda8-48a1-964e-dbbf5aae9b13 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:06.225594 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3d319290-fda8-48a1-964e-dbbf5aae9b13 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:06.226024 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3d319290-fda8-48a1-964e-dbbf5aae9b13 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:06.226705 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3d319290-fda8-48a1-964e-dbbf5aae9b13 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:06.227171 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3d319290-fda8-48a1-964e-dbbf5aae9b13 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:06.227589 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3d319290-fda8-48a1-964e-dbbf5aae9b13 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:06.355658 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-3d319290-fda8-48a1-964e-dbbf5aae9b13 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:06.363300 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-3d319290-fda8-48a1-964e-dbbf5aae9b13 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.149197 Aug 26 15:58:06.363869 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 117/212] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:06 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:07.106419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-0ed4e7ba-c12e-4bfe-b12b-2c838863d28a tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:07.107013 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-0ed4e7ba-c12e-4bfe-b12b-2c838863d28a tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:07.113670 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0ed4e7ba-c12e-4bfe-b12b-2c838863d28a tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:07.114354 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0ed4e7ba-c12e-4bfe-b12b-2c838863d28a tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:07.114956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0ed4e7ba-c12e-4bfe-b12b-2c838863d28a tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:07.115788 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0ed4e7ba-c12e-4bfe-b12b-2c838863d28a tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:07.116346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0ed4e7ba-c12e-4bfe-b12b-2c838863d28a tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:07.116932 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0ed4e7ba-c12e-4bfe-b12b-2c838863d28a tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:07.135505 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-0ed4e7ba-c12e-4bfe-b12b-2c838863d28a tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] HTTP exception thrown: Instance 4425d401-9f5d-4aa8-a568-35ee9cd768bf could not be found. Aug 26 15:58:07.145302 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-0ed4e7ba-c12e-4bfe-b12b-2c838863d28a tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Request method failure captured: Aug 26 15:58:07.145302 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: DELETE /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf HTTP/1.1 Aug 26 15:58:07.145302 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 15:58:07.145302 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 15:58:07.145302 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 15:58:07.145302 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 0 Aug 26 15:58:07.145302 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 15:58:07.145302 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 15:58:07.145302 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 15:58:07.145302 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 15:58:07.145302 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO1E7kQhm-satQaN6C0OftN-FnRQIZPQwemFrXNphHMtr8xe9G_BeoAVQFHMQattW-bjCTS1YwyhSOwdBxfKdZvJDd4WKTiJaK2zp-3JPcZpYrwXiaWPUX2Y2LCzJdIP1Mu1LklBTodqZAJc8WB-FKTiIwH1WLmCTjrlMv4wCWuAQ0U Aug 26 15:58:07.145302 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 15:58:07.145302 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 15:58:07.145302 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 15:58:07.145302 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 15:58:07.145302 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 15:58:07.145302 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 15:58:07.145302 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: e649b58115ab4bcbbf045a3c036a3049 Aug 26 15:58:07.145302 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-DeleteServersTestJSON-97909677 Aug 26 15:58:07.145302 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 15:58:07.145302 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 15:58:07.146645 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/e649b58115ab4bcbbf045a3c036a3049"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/e649b58115ab4bcbbf045a3c036a3049"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/e649b58115ab4bcbbf045a3c036a3049"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_e649b58115ab4bcbbf045a3c036a3049", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 15:58:07.146645 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-DeleteServersTestJSON-97909677 Aug 26 15:58:07.146645 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: e649b58115ab4bcbbf045a3c036a3049 Aug 26 15:58:07.146645 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-DeleteServersTestJSON-97909677 Aug 26 15:58:07.146645 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-DeleteServersTestJSON-97909677-project Aug 26 15:58:07.146645 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 15:58:07.146645 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 15:58:07.146645 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: f56fcb6b073d4f1d9dabab1e0bac6ec3 Aug 26 15:58:07.146645 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-DeleteServersTestJSON-97909677-project Aug 26 15:58:07.146645 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: > Aug 26 15:58:07.146645 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Instance 4425d401-9f5d-4aa8-a568-35ee9cd768bf could not be found. Aug 26 15:58:07.146645 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'id': '4425d401-9f5d-4aa8-a568-35ee9cd768bf'} Aug 26 15:58:07.147340 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:58:07.147340 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:07.147340 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:58:07.147340 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:58:07.147340 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:58:07.147340 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:58:07.147340 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:58:07.147340 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:58:07.147340 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:58:07.147340 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:58:07.147340 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4425d401-9f5d-4aa8-a568-35ee9cd768bf could not be found. Aug 26 15:58:07.147340 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 15:58:07.147340 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:07.147340 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 15:58:07.147340 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:07.147340 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:07.147340 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:07.147340 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:58:07.147340 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:58:07.147340 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:58:07.148316 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:58:07.148316 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 15:58:07.148316 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 15:58:07.148316 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 15:58:07.148316 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 15:58:07.148316 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:58:07.148316 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:58:07.148316 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:58:07.148316 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:58:07.148316 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4425d401-9f5d-4aa8-a568-35ee9cd768bf could not be found. Aug 26 15:58:07.148316 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 15:58:07.148316 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:07.148316 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 15:58:07.148316 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:07.148316 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:07.148316 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:07.148316 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:58:07.148316 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:58:07.148316 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4425d401-9f5d-4aa8-a568-35ee9cd768bf could not be found. Aug 26 15:58:07.148316 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 15:58:07.149441 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-0ed4e7ba-c12e-4bfe-b12b-2c838863d28a tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Returning 404 to user: Instance 4425d401-9f5d-4aa8-a568-35ee9cd768bf could not be found. {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:58:07.149441 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-0ed4e7ba-c12e-4bfe-b12b-2c838863d28a tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "DELETE /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 404 len: 111 microversion: 2.1 time: 0.045194 Aug 26 15:58:07.149441 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 96/213] 10.222.0.94 () {58 vars in 1239 bytes} [Fri Aug 26 15:58:07 2022] DELETE /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 15:58:07.161785 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-6a0048a0-b918-491f-ba97-9e3b43c3648e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:07.162391 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-6a0048a0-b918-491f-ba97-9e3b43c3648e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] [instance: 4425d401-9f5d-4aa8-a568-35ee9cd768bf] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:07.168506 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6a0048a0-b918-491f-ba97-9e3b43c3648e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:07.168997 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6a0048a0-b918-491f-ba97-9e3b43c3648e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:07.169436 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6a0048a0-b918-491f-ba97-9e3b43c3648e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:07.179720 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6a0048a0-b918-491f-ba97-9e3b43c3648e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:07.180210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6a0048a0-b918-491f-ba97-9e3b43c3648e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:07.180653 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6a0048a0-b918-491f-ba97-9e3b43c3648e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:07.193675 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-48cd2958-a53f-4533-95ce-a442793305c0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:07.194300 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-48cd2958-a53f-4533-95ce-a442793305c0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 2ca57bbc-68ea-4114-a936-36f8ef102682] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:07.196039 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.wsgi [None req-6a0048a0-b918-491f-ba97-9e3b43c3648e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] HTTP exception thrown: Instance 4425d401-9f5d-4aa8-a568-35ee9cd768bf could not be found. Aug 26 15:58:07.197656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-6a0048a0-b918-491f-ba97-9e3b43c3648e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Request method failure captured: Aug 26 15:58:07.197656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: request: GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf HTTP/1.1 Aug 26 15:58:07.197656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept: application/json Aug 26 15:58:07.197656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept-Encoding: identity Aug 26 15:58:07.197656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Connection: close Aug 26 15:58:07.197656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Length: 0 Aug 26 15:58:07.197656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Type: application/json Aug 26 15:58:07.197656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Host: 10.222.0.94 Aug 26 15:58:07.197656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Openstack-System-Scope: None Aug 26 15:58:07.197656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: User-Agent: python-urllib3/1.26.11 Aug 26 15:58:07.197656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Auth-Token: gAAAAABjCO1E7kQhm-satQaN6C0OftN-FnRQIZPQwemFrXNphHMtr8xe9G_BeoAVQFHMQattW-bjCTS1YwyhSOwdBxfKdZvJDd4WKTiJaK2zp-3JPcZpYrwXiaWPUX2Y2LCzJdIP1Mu1LklBTodqZAJc8WB-FKTiIwH1WLmCTjrlMv4wCWuAQ0U Aug 26 15:58:07.197656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Id: None Aug 26 15:58:07.197656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Name: None Aug 26 15:58:07.197656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Identity-Status: Confirmed Aug 26 15:58:07.197656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Is-Admin-Project: True Aug 26 15:58:07.197656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Id: default Aug 26 15:58:07.197656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Name: Default Aug 26 15:58:07.197656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Id: e649b58115ab4bcbbf045a3c036a3049 Aug 26 15:58:07.197656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Name: tempest-DeleteServersTestJSON-97909677 Aug 26 15:58:07.197656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Role: member,reader Aug 26 15:58:07.197656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Roles: member,reader Aug 26 15:58:07.198779 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/e649b58115ab4bcbbf045a3c036a3049"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/e649b58115ab4bcbbf045a3c036a3049"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/e649b58115ab4bcbbf045a3c036a3049"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_e649b58115ab4bcbbf045a3c036a3049", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 15:58:07.198779 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant: tempest-DeleteServersTestJSON-97909677 Aug 26 15:58:07.198779 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Id: e649b58115ab4bcbbf045a3c036a3049 Aug 26 15:58:07.198779 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Name: tempest-DeleteServersTestJSON-97909677 Aug 26 15:58:07.198779 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User: tempest-DeleteServersTestJSON-97909677-project Aug 26 15:58:07.198779 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Id: default Aug 26 15:58:07.198779 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Name: Default Aug 26 15:58:07.198779 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Id: f56fcb6b073d4f1d9dabab1e0bac6ec3 Aug 26 15:58:07.198779 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Name: tempest-DeleteServersTestJSON-97909677-project Aug 26 15:58:07.198779 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: method: > Aug 26 15:58:07.198779 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: exception: Instance 4425d401-9f5d-4aa8-a568-35ee9cd768bf could not be found. Aug 26 15:58:07.198779 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: action_args: {'id': '4425d401-9f5d-4aa8-a568-35ee9cd768bf'} Aug 26 15:58:07.200050 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:58:07.200050 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:07.200050 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:58:07.200050 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:58:07.200050 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:58:07.200050 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:58:07.200050 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:58:07.200050 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:58:07.200050 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:58:07.200050 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:58:07.200050 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4425d401-9f5d-4aa8-a568-35ee9cd768bf could not be found. Aug 26 15:58:07.200050 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 15:58:07.200050 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:07.200050 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 15:58:07.200050 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:07.200050 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:07.200050 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:07.200050 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:58:07.200050 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:58:07.200050 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:58:07.201278 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:58:07.201278 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 15:58:07.201278 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 15:58:07.201278 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:58:07.201278 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:58:07.201278 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:58:07.201278 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:58:07.201278 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4425d401-9f5d-4aa8-a568-35ee9cd768bf could not be found. Aug 26 15:58:07.201278 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 15:58:07.201278 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:07.201278 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 15:58:07.201278 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:07.201278 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:07.201278 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:07.201278 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:58:07.201278 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:58:07.201278 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4425d401-9f5d-4aa8-a568-35ee9cd768bf could not be found. Aug 26 15:58:07.201278 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 15:58:07.202470 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-48cd2958-a53f-4533-95ce-a442793305c0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:07.202676 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-48cd2958-a53f-4533-95ce-a442793305c0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:07.203204 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-48cd2958-a53f-4533-95ce-a442793305c0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:07.203808 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-48cd2958-a53f-4533-95ce-a442793305c0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:07.204264 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-48cd2958-a53f-4533-95ce-a442793305c0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:07.204542 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-6a0048a0-b918-491f-ba97-9e3b43c3648e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] Returning 404 to user: Instance 4425d401-9f5d-4aa8-a568-35ee9cd768bf could not be found. {{(pid=128305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:58:07.204775 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-48cd2958-a53f-4533-95ce-a442793305c0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:07.205539 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-6a0048a0-b918-491f-ba97-9e3b43c3648e tempest-DeleteServersTestJSON-97909677 tempest-DeleteServersTestJSON-97909677-project] 10.222.0.94 "GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf" status: 404 len: 111 microversion: 2.1 time: 0.047598 Aug 26 15:58:07.206174 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 118/214] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:07 2022] GET /compute/v2.1/servers/4425d401-9f5d-4aa8-a568-35ee9cd768bf => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:58:07.294629 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-48cd2958-a53f-4533-95ce-a442793305c0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:07.302425 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-48cd2958-a53f-4533-95ce-a442793305c0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682" status: 200 len: 1265 microversion: 2.1 time: 0.112713 Aug 26 15:58:07.303055 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 97/215] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:07 2022] GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682 => generated 1265 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:07.384812 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-94d2d37e-7d40-4aaf-b06a-3139f5db10dd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:07.386049 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-94d2d37e-7d40-4aaf-b06a-3139f5db10dd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:07.393939 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-94d2d37e-7d40-4aaf-b06a-3139f5db10dd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:07.394449 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-94d2d37e-7d40-4aaf-b06a-3139f5db10dd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:07.395087 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-94d2d37e-7d40-4aaf-b06a-3139f5db10dd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:07.395780 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-94d2d37e-7d40-4aaf-b06a-3139f5db10dd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:07.396377 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-94d2d37e-7d40-4aaf-b06a-3139f5db10dd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:07.396959 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-94d2d37e-7d40-4aaf-b06a-3139f5db10dd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:07.785801 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-94d2d37e-7d40-4aaf-b06a-3139f5db10dd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:07.797824 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-94d2d37e-7d40-4aaf-b06a-3139f5db10dd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.417036 Aug 26 15:58:07.798787 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 119/216] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:07 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:08.325643 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-8238a96b-aabe-46eb-aab1-18f8009fcd75 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:08.326266 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-8238a96b-aabe-46eb-aab1-18f8009fcd75 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 2ca57bbc-68ea-4114-a936-36f8ef102682] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:08.339693 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8238a96b-aabe-46eb-aab1-18f8009fcd75 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:08.342304 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8238a96b-aabe-46eb-aab1-18f8009fcd75 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:08.342304 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8238a96b-aabe-46eb-aab1-18f8009fcd75 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:08.342304 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8238a96b-aabe-46eb-aab1-18f8009fcd75 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:08.342587 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8238a96b-aabe-46eb-aab1-18f8009fcd75 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:08.342947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8238a96b-aabe-46eb-aab1-18f8009fcd75 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:08.410751 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-8238a96b-aabe-46eb-aab1-18f8009fcd75 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:08.421109 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-8238a96b-aabe-46eb-aab1-18f8009fcd75 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682" status: 200 len: 1273 microversion: 2.1 time: 0.100409 Aug 26 15:58:08.421685 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 98/217] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:08 2022] GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682 => generated 1273 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:08.819928 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-38a46f25-419a-4b66-8d2c-46be3cae0b4d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:08.821253 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-38a46f25-419a-4b66-8d2c-46be3cae0b4d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:08.829733 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-38a46f25-419a-4b66-8d2c-46be3cae0b4d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:08.830555 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-38a46f25-419a-4b66-8d2c-46be3cae0b4d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:08.831277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-38a46f25-419a-4b66-8d2c-46be3cae0b4d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:08.832468 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-38a46f25-419a-4b66-8d2c-46be3cae0b4d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:08.833211 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-38a46f25-419a-4b66-8d2c-46be3cae0b4d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:08.833865 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-38a46f25-419a-4b66-8d2c-46be3cae0b4d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:08.838533 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:09.045202 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-38a46f25-419a-4b66-8d2c-46be3cae0b4d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:09.053880 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-38a46f25-419a-4b66-8d2c-46be3cae0b4d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.238118 Aug 26 15:58:09.059712 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 120/218] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:08 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:09.443519 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-4921635d-68b5-43d0-94c6-26d423c29183 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:09.446541 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-4921635d-68b5-43d0-94c6-26d423c29183 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 2ca57bbc-68ea-4114-a936-36f8ef102682] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:09.453835 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4921635d-68b5-43d0-94c6-26d423c29183 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:09.454325 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4921635d-68b5-43d0-94c6-26d423c29183 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:09.454765 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4921635d-68b5-43d0-94c6-26d423c29183 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:09.455496 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4921635d-68b5-43d0-94c6-26d423c29183 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:09.455955 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4921635d-68b5-43d0-94c6-26d423c29183 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:09.456379 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4921635d-68b5-43d0-94c6-26d423c29183 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:09.522986 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-4921635d-68b5-43d0-94c6-26d423c29183 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:09.533065 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-4921635d-68b5-43d0-94c6-26d423c29183 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682" status: 200 len: 1283 microversion: 2.1 time: 0.093528 Aug 26 15:58:09.545627 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 99/219] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:09 2022] GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682 => generated 1283 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:10.076126 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a8d43615-67b3-444b-a05c-86ef30d2234f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:10.077105 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a8d43615-67b3-444b-a05c-86ef30d2234f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:10.082987 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a8d43615-67b3-444b-a05c-86ef30d2234f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:10.083519 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a8d43615-67b3-444b-a05c-86ef30d2234f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:10.083958 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a8d43615-67b3-444b-a05c-86ef30d2234f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:10.084658 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a8d43615-67b3-444b-a05c-86ef30d2234f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:10.085143 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a8d43615-67b3-444b-a05c-86ef30d2234f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:10.085532 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a8d43615-67b3-444b-a05c-86ef30d2234f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:10.267144 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a8d43615-67b3-444b-a05c-86ef30d2234f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:10.275408 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a8d43615-67b3-444b-a05c-86ef30d2234f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.203812 Aug 26 15:58:10.276013 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 121/220] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:10 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:10.558202 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-4ac22b7f-9cce-46a1-bc23-0952642eb9a7 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:10.559087 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-4ac22b7f-9cce-46a1-bc23-0952642eb9a7 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 2ca57bbc-68ea-4114-a936-36f8ef102682] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:10.566681 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ac22b7f-9cce-46a1-bc23-0952642eb9a7 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:10.568029 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ac22b7f-9cce-46a1-bc23-0952642eb9a7 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:10.568692 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ac22b7f-9cce-46a1-bc23-0952642eb9a7 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:10.569611 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ac22b7f-9cce-46a1-bc23-0952642eb9a7 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:10.570139 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ac22b7f-9cce-46a1-bc23-0952642eb9a7 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:10.570628 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ac22b7f-9cce-46a1-bc23-0952642eb9a7 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:10.575868 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=100 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:10.725517 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-4ac22b7f-9cce-46a1-bc23-0952642eb9a7 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:10.735760 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-4ac22b7f-9cce-46a1-bc23-0952642eb9a7 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682" status: 200 len: 1283 microversion: 2.1 time: 0.181642 Aug 26 15:58:10.736541 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 100/221] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:10 2022] GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682 => generated 1283 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:11.298841 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-dc01455e-54b9-40b0-848b-e60dfed1c9e3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:11.299500 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-dc01455e-54b9-40b0-848b-e60dfed1c9e3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:11.307679 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dc01455e-54b9-40b0-848b-e60dfed1c9e3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:11.307679 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dc01455e-54b9-40b0-848b-e60dfed1c9e3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:11.308045 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dc01455e-54b9-40b0-848b-e60dfed1c9e3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:11.308985 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dc01455e-54b9-40b0-848b-e60dfed1c9e3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:11.309936 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dc01455e-54b9-40b0-848b-e60dfed1c9e3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:11.310536 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dc01455e-54b9-40b0-848b-e60dfed1c9e3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:11.607469 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-dc01455e-54b9-40b0-848b-e60dfed1c9e3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:11.621735 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-dc01455e-54b9-40b0-848b-e60dfed1c9e3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.325564 Aug 26 15:58:11.624566 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 122/222] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:11 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:11.757839 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-1598d963-a7ea-4fce-ace0-fae027a27bb4 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:11.758445 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-1598d963-a7ea-4fce-ace0-fae027a27bb4 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 2ca57bbc-68ea-4114-a936-36f8ef102682] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:11.780287 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1598d963-a7ea-4fce-ace0-fae027a27bb4 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:11.780823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1598d963-a7ea-4fce-ace0-fae027a27bb4 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:11.784919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1598d963-a7ea-4fce-ace0-fae027a27bb4 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:11.786445 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1598d963-a7ea-4fce-ace0-fae027a27bb4 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:11.789922 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1598d963-a7ea-4fce-ace0-fae027a27bb4 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:11.789922 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1598d963-a7ea-4fce-ace0-fae027a27bb4 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:12.012724 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-1598d963-a7ea-4fce-ace0-fae027a27bb4 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:12.020999 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-1598d963-a7ea-4fce-ace0-fae027a27bb4 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682" status: 200 len: 1313 microversion: 2.1 time: 0.266796 Aug 26 15:58:12.034890 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 101/223] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:11 2022] GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682 => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:12.644617 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-ab399720-bc62-4764-a639-6b81f11cdbfb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:12.646173 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-ab399720-bc62-4764-a639-6b81f11cdbfb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:12.653406 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ab399720-bc62-4764-a639-6b81f11cdbfb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:12.653886 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ab399720-bc62-4764-a639-6b81f11cdbfb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:12.654310 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ab399720-bc62-4764-a639-6b81f11cdbfb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:12.655171 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ab399720-bc62-4764-a639-6b81f11cdbfb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:12.655596 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ab399720-bc62-4764-a639-6b81f11cdbfb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:12.656016 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ab399720-bc62-4764-a639-6b81f11cdbfb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:12.788508 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-ab399720-bc62-4764-a639-6b81f11cdbfb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:12.798073 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-ab399720-bc62-4764-a639-6b81f11cdbfb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.158384 Aug 26 15:58:12.798828 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 123/224] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:12 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:12.807384 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-85ab47ec-3629-476f-89fb-11c3400f5bc8 req-dfc06823-e400-4b78-bb37-d9c0921e02b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ca57bbc-68ea-4114-a936-36f8ef102682", "tag": "b58125e8-2973-41d3-8208-c72a7386dd43"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:58:12.826016 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell0:SELECT=2 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:12.826016 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-85ab47ec-3629-476f-89fb-11c3400f5bc8 req-dfc06823-e400-4b78-bb37-d9c0921e02b5 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:12.826016 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-85ab47ec-3629-476f-89fb-11c3400f5bc8 req-dfc06823-e400-4b78-bb37-d9c0921e02b5 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:12.826016 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-85ab47ec-3629-476f-89fb-11c3400f5bc8 req-dfc06823-e400-4b78-bb37-d9c0921e02b5 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:12.839549 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-85ab47ec-3629-476f-89fb-11c3400f5bc8 req-dfc06823-e400-4b78-bb37-d9c0921e02b5 service nova] Creating event network-changed:b58125e8-2973-41d3-8208-c72a7386dd43 for instance 2ca57bbc-68ea-4114-a936-36f8ef102682 on hv-cinder-85144 Aug 26 15:58:12.854479 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-85ab47ec-3629-476f-89fb-11c3400f5bc8 req-dfc06823-e400-4b78-bb37-d9c0921e02b5 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052285 Aug 26 15:58:12.855110 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 102/225] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 15:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:58:13.041764 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-cef076fb-1cf1-4d22-ad92-de81af375b98 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:13.042452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-cef076fb-1cf1-4d22-ad92-de81af375b98 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 2ca57bbc-68ea-4114-a936-36f8ef102682] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:13.048716 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cef076fb-1cf1-4d22-ad92-de81af375b98 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:13.049185 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cef076fb-1cf1-4d22-ad92-de81af375b98 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:13.053308 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cef076fb-1cf1-4d22-ad92-de81af375b98 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:13.053308 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cef076fb-1cf1-4d22-ad92-de81af375b98 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:13.053308 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cef076fb-1cf1-4d22-ad92-de81af375b98 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:13.053308 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cef076fb-1cf1-4d22-ad92-de81af375b98 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:13.287344 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-cef076fb-1cf1-4d22-ad92-de81af375b98 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:13.301013 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-cef076fb-1cf1-4d22-ad92-de81af375b98 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682" status: 200 len: 1313 microversion: 2.1 time: 0.257899 Aug 26 15:58:13.301013 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 124/226] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:13 2022] GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:13.822610 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-4f46a085-c1a4-466e-94fd-553ee4278def tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:13.823297 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-4f46a085-c1a4-466e-94fd-553ee4278def tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:13.830514 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4f46a085-c1a4-466e-94fd-553ee4278def tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:13.831048 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4f46a085-c1a4-466e-94fd-553ee4278def tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:13.831494 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4f46a085-c1a4-466e-94fd-553ee4278def tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:13.832196 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4f46a085-c1a4-466e-94fd-553ee4278def tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:13.832671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4f46a085-c1a4-466e-94fd-553ee4278def tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:13.833098 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4f46a085-c1a4-466e-94fd-553ee4278def tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:13.959314 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell0:SELECT=10 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:13.977155 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-4f46a085-c1a4-466e-94fd-553ee4278def tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:13.986025 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-4f46a085-c1a4-466e-94fd-553ee4278def tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.168181 Aug 26 15:58:13.986586 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 103/227] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:13 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:14.247664 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-b805fc10-226d-4ebc-bfab-169808b7ebe3 tempest-VolumesGetTestJSON-116827105 tempest-VolumesGetTestJSON-116827105-project] Action: 'create', calling method: .version_select at 0x7f15d9807ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1678217710", "metadata": {"Type": "work"}}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:58:14.319341 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-88d20348-96a8-46ec-ad0d-f6947cfd6f6e tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:14.320116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-88d20348-96a8-46ec-ad0d-f6947cfd6f6e tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 2ca57bbc-68ea-4114-a936-36f8ef102682] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:14.327318 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-88d20348-96a8-46ec-ad0d-f6947cfd6f6e tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:14.327808 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-88d20348-96a8-46ec-ad0d-f6947cfd6f6e tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:14.328246 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-88d20348-96a8-46ec-ad0d-f6947cfd6f6e tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:14.328939 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-88d20348-96a8-46ec-ad0d-f6947cfd6f6e tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:14.329391 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-88d20348-96a8-46ec-ad0d-f6947cfd6f6e tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:14.329820 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-88d20348-96a8-46ec-ad0d-f6947cfd6f6e tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:14.466044 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-88d20348-96a8-46ec-ad0d-f6947cfd6f6e tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:14.474319 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-88d20348-96a8-46ec-ad0d-f6947cfd6f6e tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682" status: 200 len: 1313 microversion: 2.1 time: 0.158788 Aug 26 15:58:14.474883 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 104/228] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:14 2022] GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:15.007904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-1897ba86-e299-489b-a026-3311bdc69531 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:15.009247 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-1897ba86-e299-489b-a026-3311bdc69531 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:15.020703 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1897ba86-e299-489b-a026-3311bdc69531 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:15.020703 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1897ba86-e299-489b-a026-3311bdc69531 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:15.020703 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1897ba86-e299-489b-a026-3311bdc69531 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:15.020703 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1897ba86-e299-489b-a026-3311bdc69531 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:15.021077 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1897ba86-e299-489b-a026-3311bdc69531 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:15.021077 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1897ba86-e299-489b-a026-3311bdc69531 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:15.131220 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-b805fc10-226d-4ebc-bfab-169808b7ebe3 tempest-VolumesGetTestJSON-116827105 tempest-VolumesGetTestJSON-116827105-project] 10.222.0.94 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.999848 Aug 26 15:58:15.143225 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 125/229] 10.222.0.94 () {60 vars in 1156 bytes} [Fri Aug 26 15:58:14 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1014 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 26 15:58:15.149304 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-506cf9b6-2bdd-4144-b496-84aa4ce68a93 tempest-VolumesGetTestJSON-116827105 tempest-VolumesGetTestJSON-116827105-project] Calling method '.version_select at 0x7f15d97a6ee0>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:15.206305 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-1897ba86-e299-489b-a026-3311bdc69531 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:15.216232 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-1897ba86-e299-489b-a026-3311bdc69531 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.212960 Aug 26 15:58:15.217005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 105/230] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:15 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:15.245649 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-506cf9b6-2bdd-4144-b496-84aa4ce68a93 tempest-VolumesGetTestJSON-116827105 tempest-VolumesGetTestJSON-116827105-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/f979182f-2cbd-428c-bc6a-79dba1fa9917" status: 200 len: 353 microversion: 2.1 time: 0.100902 Aug 26 15:58:15.246856 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 126/231] 10.222.0.94 () {58 vars in 1245 bytes} [Fri Aug 26 15:58:15 2022] GET /compute/v2.1/os-volumes/f979182f-2cbd-428c-bc6a-79dba1fa9917 => generated 353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:58:15.494894 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-378fcc2b-1f4c-41c1-a7c8-b99d5959d960 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:15.495527 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-378fcc2b-1f4c-41c1-a7c8-b99d5959d960 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 2ca57bbc-68ea-4114-a936-36f8ef102682] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:15.502630 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-378fcc2b-1f4c-41c1-a7c8-b99d5959d960 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:15.503240 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-378fcc2b-1f4c-41c1-a7c8-b99d5959d960 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:15.504034 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-378fcc2b-1f4c-41c1-a7c8-b99d5959d960 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:15.505785 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-378fcc2b-1f4c-41c1-a7c8-b99d5959d960 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:15.506471 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-378fcc2b-1f4c-41c1-a7c8-b99d5959d960 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:15.506936 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-378fcc2b-1f4c-41c1-a7c8-b99d5959d960 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:15.677219 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-378fcc2b-1f4c-41c1-a7c8-b99d5959d960 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:15.685675 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-378fcc2b-1f4c-41c1-a7c8-b99d5959d960 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682" status: 200 len: 1313 microversion: 2.1 time: 0.195271 Aug 26 15:58:15.686368 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 106/232] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:15 2022] GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:16.238368 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-1eba4dd5-bf6d-4c16-8881-996460f87f3a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:16.239021 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-1eba4dd5-bf6d-4c16-8881-996460f87f3a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:16.247150 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1eba4dd5-bf6d-4c16-8881-996460f87f3a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:16.247721 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1eba4dd5-bf6d-4c16-8881-996460f87f3a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:16.248212 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1eba4dd5-bf6d-4c16-8881-996460f87f3a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:16.248921 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1eba4dd5-bf6d-4c16-8881-996460f87f3a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:16.249279 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1eba4dd5-bf6d-4c16-8881-996460f87f3a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:16.249703 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1eba4dd5-bf6d-4c16-8881-996460f87f3a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:16.260063 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ae5da5e9-4876-4df9-b57a-0484fa2f99ff tempest-VolumesGetTestJSON-116827105 tempest-VolumesGetTestJSON-116827105-project] Calling method '.version_select at 0x7f15d9af5c10>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:16.319477 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ae5da5e9-4876-4df9-b57a-0484fa2f99ff tempest-VolumesGetTestJSON-116827105 tempest-VolumesGetTestJSON-116827105-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/f979182f-2cbd-428c-bc6a-79dba1fa9917" status: 200 len: 354 microversion: 2.1 time: 0.062966 Aug 26 15:58:16.320658 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 107/233] 10.222.0.94 () {58 vars in 1245 bytes} [Fri Aug 26 15:58:16 2022] GET /compute/v2.1/os-volumes/f979182f-2cbd-428c-bc6a-79dba1fa9917 => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:58:16.334480 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-16278319-aac9-4069-b580-97fad1799416 tempest-VolumesGetTestJSON-116827105 tempest-VolumesGetTestJSON-116827105-project] Calling method '.version_select at 0x7f15d98c2670>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:16.396354 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-16278319-aac9-4069-b580-97fad1799416 tempest-VolumesGetTestJSON-116827105 tempest-VolumesGetTestJSON-116827105-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/f979182f-2cbd-428c-bc6a-79dba1fa9917" status: 200 len: 354 microversion: 2.1 time: 0.067575 Aug 26 15:58:16.397086 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 108/234] 10.222.0.94 () {58 vars in 1245 bytes} [Fri Aug 26 15:58:16 2022] GET /compute/v2.1/os-volumes/f979182f-2cbd-428c-bc6a-79dba1fa9917 => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:58:16.413438 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-1eba4dd5-bf6d-4c16-8881-996460f87f3a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:16.416208 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-75463a28-9dd7-4c20-a46b-a1ec5448ac2b tempest-VolumesGetTestJSON-116827105 tempest-VolumesGetTestJSON-116827105-project] Calling method '.version_select at 0x7f15d979f4c0>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:16.427661 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-1eba4dd5-bf6d-4c16-8881-996460f87f3a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.192676 Aug 26 15:58:16.430486 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 127/235] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:16 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:16.615604 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-75463a28-9dd7-4c20-a46b-a1ec5448ac2b tempest-VolumesGetTestJSON-116827105 tempest-VolumesGetTestJSON-116827105-project] 10.222.0.94 "DELETE /compute/v2.1/os-volumes/f979182f-2cbd-428c-bc6a-79dba1fa9917" status: 202 len: 0 microversion: 2.1 time: 0.203337 Aug 26 15:58:16.616017 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 109/236] 10.222.0.94 () {58 vars in 1248 bytes} [Fri Aug 26 15:58:16 2022] DELETE /compute/v2.1/os-volumes/f979182f-2cbd-428c-bc6a-79dba1fa9917 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 15:58:16.625538 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-25801040-80e8-433c-9801-5c0484b15169 tempest-VolumesGetTestJSON-116827105 tempest-VolumesGetTestJSON-116827105-project] Calling method '.version_select at 0x7f15d97a6160>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:16.677223 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-25801040-80e8-433c-9801-5c0484b15169 tempest-VolumesGetTestJSON-116827105 tempest-VolumesGetTestJSON-116827105-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/f979182f-2cbd-428c-bc6a-79dba1fa9917" status: 200 len: 353 microversion: 2.1 time: 0.056777 Aug 26 15:58:16.677791 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 128/237] 10.222.0.94 () {58 vars in 1245 bytes} [Fri Aug 26 15:58:16 2022] GET /compute/v2.1/os-volumes/f979182f-2cbd-428c-bc6a-79dba1fa9917 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:58:16.707533 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-92cfab19-5dfd-42ad-a04e-25d20752e555 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:16.708180 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-92cfab19-5dfd-42ad-a04e-25d20752e555 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 2ca57bbc-68ea-4114-a936-36f8ef102682] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:16.714241 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-92cfab19-5dfd-42ad-a04e-25d20752e555 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:16.715446 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-92cfab19-5dfd-42ad-a04e-25d20752e555 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:16.716278 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-92cfab19-5dfd-42ad-a04e-25d20752e555 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:16.716980 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-92cfab19-5dfd-42ad-a04e-25d20752e555 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:16.717435 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-92cfab19-5dfd-42ad-a04e-25d20752e555 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:16.717867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-92cfab19-5dfd-42ad-a04e-25d20752e555 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:16.853271 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-92cfab19-5dfd-42ad-a04e-25d20752e555 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:16.863929 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-92cfab19-5dfd-42ad-a04e-25d20752e555 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682" status: 200 len: 1313 microversion: 2.1 time: 0.160041 Aug 26 15:58:16.864459 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 110/238] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:16 2022] GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:17.449105 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-367717c9-07ca-454a-a693-b165dc848df4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:17.449691 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-367717c9-07ca-454a-a693-b165dc848df4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:17.456104 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-367717c9-07ca-454a-a693-b165dc848df4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:17.456520 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-367717c9-07ca-454a-a693-b165dc848df4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:17.456953 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-367717c9-07ca-454a-a693-b165dc848df4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:17.457638 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-367717c9-07ca-454a-a693-b165dc848df4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:17.458086 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-367717c9-07ca-454a-a693-b165dc848df4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:17.458509 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-367717c9-07ca-454a-a693-b165dc848df4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:17.732062 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-367717c9-07ca-454a-a693-b165dc848df4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:17.732062 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-367717c9-07ca-454a-a693-b165dc848df4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.245529 Aug 26 15:58:17.732062 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 129/239] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:17 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:17.732852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-d8c183c2-9724-4a21-9939-e0a34582e911 tempest-VolumesGetTestJSON-116827105 tempest-VolumesGetTestJSON-116827105-project] Calling method '.version_select at 0x7f15d979f0d0>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:17.732852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-d8c183c2-9724-4a21-9939-e0a34582e911 tempest-VolumesGetTestJSON-116827105 tempest-VolumesGetTestJSON-116827105-project] HTTP exception thrown: Volume f979182f-2cbd-428c-bc6a-79dba1fa9917 could not be found. Aug 26 15:58:17.732852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-d8c183c2-9724-4a21-9939-e0a34582e911 tempest-VolumesGetTestJSON-116827105 tempest-VolumesGetTestJSON-116827105-project] Request method failure captured: Aug 26 15:58:17.732852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: GET /compute/v2.1/os-volumes/f979182f-2cbd-428c-bc6a-79dba1fa9917 HTTP/1.1 Aug 26 15:58:17.732852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 15:58:17.732852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 15:58:17.732852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 15:58:17.732852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 0 Aug 26 15:58:17.732852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 15:58:17.732852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 15:58:17.732852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 15:58:17.732852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 15:58:17.732852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO2WfS5nyrxpA_isLUxUyQyrn_ijyFdP3HrjPKMJQ2OnazuCMJX7zSZUReWEKL7ztLu6mD6KqTIgI-2QOhk9R9liXlaiXXjH0mf6WcaT5UkDMYnDFqTxF2MI9fvd52sRMVvb1oQAoAA_AQVP1lksD1pXT5pKyUAn_4jEtRw0P_xThSU Aug 26 15:58:17.732852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 15:58:17.732852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 15:58:17.732852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 15:58:17.732852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 15:58:17.732852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 15:58:17.732852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 15:58:17.732852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: ffe6501464cc4c45994be1b272106870 Aug 26 15:58:17.732852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-VolumesGetTestJSON-116827105 Aug 26 15:58:17.732852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 15:58:17.732852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 15:58:17.735230 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/ffe6501464cc4c45994be1b272106870"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/ffe6501464cc4c45994be1b272106870"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/ffe6501464cc4c45994be1b272106870"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_ffe6501464cc4c45994be1b272106870", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 15:58:17.735230 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-VolumesGetTestJSON-116827105 Aug 26 15:58:17.735230 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: ffe6501464cc4c45994be1b272106870 Aug 26 15:58:17.735230 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-VolumesGetTestJSON-116827105 Aug 26 15:58:17.735230 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-VolumesGetTestJSON-116827105-project Aug 26 15:58:17.735230 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 15:58:17.735230 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 15:58:17.735230 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: 419e09ee94b14a639b0a0716e1decdc6 Aug 26 15:58:17.735230 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-VolumesGetTestJSON-116827105-project Aug 26 15:58:17.735230 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: Aug 26 15:58:17.735230 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Volume f979182f-2cbd-428c-bc6a-79dba1fa9917 could not be found. Aug 26 15:58:17.735230 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'id': 'f979182f-2cbd-428c-bc6a-79dba1fa9917'} Aug 26 15:58:17.735230 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:58:17.736134 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:17.736134 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 15:58:17.736134 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 15:58:17.736134 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 15:58:17.736134 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 15:58:17.736134 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 15:58:17.736134 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 15:58:17.736134 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 15:58:17.736134 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 15:58:17.736134 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 15:58:17.736134 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 15:58:17.736134 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 15:58:17.736134 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 15:58:17.736134 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 15:58:17.736134 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 15:58:17.736134 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f979182f-2cbd-428c-bc6a-79dba1fa9917 could not be found. (HTTP 404) (Request-ID: req-d91eb51c-0824-4837-b555-c2e1bde519f2) Aug 26 15:58:17.736134 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 15:58:17.736134 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:17.736134 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 15:58:17.737464 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:17.737464 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 15:58:17.737464 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 15:58:17.737464 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 15:58:17.737464 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 15:58:17.737464 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 15:58:17.737464 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 15:58:17.737464 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 15:58:17.737464 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 15:58:17.737464 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 15:58:17.737464 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 15:58:17.737464 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 15:58:17.737464 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 15:58:17.737464 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 15:58:17.737464 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 15:58:17.737464 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 15:58:17.737464 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 15:58:17.737464 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 15:58:17.737464 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 15:58:17.738686 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 15:58:17.738686 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 15:58:17.738686 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 15:58:17.738686 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 15:58:17.738686 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f979182f-2cbd-428c-bc6a-79dba1fa9917 could not be found. Aug 26 15:58:17.738686 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 15:58:17.738686 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:17.738686 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 15:58:17.738686 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:17.738686 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:17.738686 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:17.738686 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:58:17.738686 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:58:17.738686 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 15:58:17.738686 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 15:58:17.738686 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:58:17.738686 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:58:17.738686 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 15:58:17.738686 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:58:17.740551 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f979182f-2cbd-428c-bc6a-79dba1fa9917 could not be found. Aug 26 15:58:17.740551 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 15:58:17.740551 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:17.740551 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 15:58:17.740551 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:17.740551 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:17.740551 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:17.740551 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:58:17.740551 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:58:17.740551 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f979182f-2cbd-428c-bc6a-79dba1fa9917 could not be found. Aug 26 15:58:17.740551 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 15:58:17.740551 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-d8c183c2-9724-4a21-9939-e0a34582e911 tempest-VolumesGetTestJSON-116827105 tempest-VolumesGetTestJSON-116827105-project] Returning 404 to user: Volume f979182f-2cbd-428c-bc6a-79dba1fa9917 could not be found. {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:58:17.740551 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-d8c183c2-9724-4a21-9939-e0a34582e911 tempest-VolumesGetTestJSON-116827105 tempest-VolumesGetTestJSON-116827105-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/f979182f-2cbd-428c-bc6a-79dba1fa9917" status: 404 len: 109 microversion: 2.1 time: 0.046148 Aug 26 15:58:17.740551 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 111/240] 10.222.0.94 () {58 vars in 1245 bytes} [Fri Aug 26 15:58:17 2022] GET /compute/v2.1/os-volumes/f979182f-2cbd-428c-bc6a-79dba1fa9917 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 15:58:17.884602 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-f0bd4f63-645d-4a57-8cd6-644e79051611 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:17.885204 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-f0bd4f63-645d-4a57-8cd6-644e79051611 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 2ca57bbc-68ea-4114-a936-36f8ef102682] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:17.891139 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f0bd4f63-645d-4a57-8cd6-644e79051611 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:17.891616 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f0bd4f63-645d-4a57-8cd6-644e79051611 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:17.892045 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f0bd4f63-645d-4a57-8cd6-644e79051611 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:17.892723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f0bd4f63-645d-4a57-8cd6-644e79051611 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:17.893164 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f0bd4f63-645d-4a57-8cd6-644e79051611 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:17.893644 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f0bd4f63-645d-4a57-8cd6-644e79051611 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:18.023198 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-f0bd4f63-645d-4a57-8cd6-644e79051611 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:18.031036 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-f0bd4f63-645d-4a57-8cd6-644e79051611 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682" status: 200 len: 1313 microversion: 2.1 time: 0.150271 Aug 26 15:58:18.031595 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 130/241] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:17 2022] GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:18.714363 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-e362990a-7288-4940-8b5d-0814c42183e4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:18.715534 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-e362990a-7288-4940-8b5d-0814c42183e4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:18.723390 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e362990a-7288-4940-8b5d-0814c42183e4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:18.728283 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e362990a-7288-4940-8b5d-0814c42183e4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:18.728283 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e362990a-7288-4940-8b5d-0814c42183e4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:18.728283 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e362990a-7288-4940-8b5d-0814c42183e4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:18.728283 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e362990a-7288-4940-8b5d-0814c42183e4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:18.728617 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e362990a-7288-4940-8b5d-0814c42183e4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:18.865469 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e362990a-7288-4940-8b5d-0814c42183e4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:18.873977 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-e362990a-7288-4940-8b5d-0814c42183e4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.163370 Aug 26 15:58:18.875022 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 112/242] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:18 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:19.054760 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-8499b585-5e96-43fc-859c-09798f0c5bc5 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:19.055417 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-8499b585-5e96-43fc-859c-09798f0c5bc5 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 2ca57bbc-68ea-4114-a936-36f8ef102682] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:19.062723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8499b585-5e96-43fc-859c-09798f0c5bc5 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:19.064416 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8499b585-5e96-43fc-859c-09798f0c5bc5 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:19.064416 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8499b585-5e96-43fc-859c-09798f0c5bc5 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:19.064416 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8499b585-5e96-43fc-859c-09798f0c5bc5 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:19.064798 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8499b585-5e96-43fc-859c-09798f0c5bc5 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:19.065190 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8499b585-5e96-43fc-859c-09798f0c5bc5 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:19.215158 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-8499b585-5e96-43fc-859c-09798f0c5bc5 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:19.223604 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-8499b585-5e96-43fc-859c-09798f0c5bc5 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682" status: 200 len: 1313 microversion: 2.1 time: 0.174682 Aug 26 15:58:19.227152 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 131/243] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:19 2022] GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:19.894829 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-6700ef50-c768-4998-ad6b-cee83d073298 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:19.895505 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-6700ef50-c768-4998-ad6b-cee83d073298 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:19.903726 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6700ef50-c768-4998-ad6b-cee83d073298 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:19.904218 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6700ef50-c768-4998-ad6b-cee83d073298 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:19.904659 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6700ef50-c768-4998-ad6b-cee83d073298 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:19.905358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6700ef50-c768-4998-ad6b-cee83d073298 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:19.905811 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6700ef50-c768-4998-ad6b-cee83d073298 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:19.906291 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6700ef50-c768-4998-ad6b-cee83d073298 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:20.036888 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-6700ef50-c768-4998-ad6b-cee83d073298 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:20.045521 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-6700ef50-c768-4998-ad6b-cee83d073298 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.154687 Aug 26 15:58:20.046094 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 113/244] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:19 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:20.245533 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-5574a44a-77fa-4423-8bc9-f810103b238a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:20.246880 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-5574a44a-77fa-4423-8bc9-f810103b238a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 2ca57bbc-68ea-4114-a936-36f8ef102682] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:20.252865 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5574a44a-77fa-4423-8bc9-f810103b238a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:20.253338 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5574a44a-77fa-4423-8bc9-f810103b238a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:20.253761 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5574a44a-77fa-4423-8bc9-f810103b238a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:20.254440 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5574a44a-77fa-4423-8bc9-f810103b238a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:20.254884 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5574a44a-77fa-4423-8bc9-f810103b238a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:20.255319 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5574a44a-77fa-4423-8bc9-f810103b238a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:20.390435 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-5574a44a-77fa-4423-8bc9-f810103b238a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:20.400585 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-5574a44a-77fa-4423-8bc9-f810103b238a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682" status: 200 len: 1313 microversion: 2.1 time: 0.158720 Aug 26 15:58:20.408466 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 132/245] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:20 2022] GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:21.066577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-0f1861f5-40d5-4173-b2ec-ec92c94a7c12 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:21.067313 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-0f1861f5-40d5-4173-b2ec-ec92c94a7c12 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:21.077443 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f1861f5-40d5-4173-b2ec-ec92c94a7c12 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:21.077942 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f1861f5-40d5-4173-b2ec-ec92c94a7c12 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:21.078369 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f1861f5-40d5-4173-b2ec-ec92c94a7c12 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:21.079113 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f1861f5-40d5-4173-b2ec-ec92c94a7c12 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:21.079545 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f1861f5-40d5-4173-b2ec-ec92c94a7c12 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:21.079988 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f1861f5-40d5-4173-b2ec-ec92c94a7c12 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:21.211822 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-0f1861f5-40d5-4173-b2ec-ec92c94a7c12 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:21.220067 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-0f1861f5-40d5-4173-b2ec-ec92c94a7c12 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1523 microversion: 2.1 time: 0.157583 Aug 26 15:58:21.220562 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 114/246] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:21 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:21.423110 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-e3c31adb-8b10-4afb-86ad-2d92ed21fe65 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:21.423110 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-e3c31adb-8b10-4afb-86ad-2d92ed21fe65 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 2ca57bbc-68ea-4114-a936-36f8ef102682] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:21.429124 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e3c31adb-8b10-4afb-86ad-2d92ed21fe65 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:21.429628 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e3c31adb-8b10-4afb-86ad-2d92ed21fe65 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:21.430139 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e3c31adb-8b10-4afb-86ad-2d92ed21fe65 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:21.430836 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e3c31adb-8b10-4afb-86ad-2d92ed21fe65 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:21.431317 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e3c31adb-8b10-4afb-86ad-2d92ed21fe65 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:21.431744 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e3c31adb-8b10-4afb-86ad-2d92ed21fe65 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:21.538497 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-bac21704-0cce-4f64-a4f1-8f62c40663e1 req-3d7214f5-5251-4d0e-bad9-28acd5fcc8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca57bbc-68ea-4114-a936-36f8ef102682", "name": "network-vif-plugged", "status": "completed", "tag": "b58125e8-2973-41d3-8208-c72a7386dd43"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:58:21.554532 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-bac21704-0cce-4f64-a4f1-8f62c40663e1 req-3d7214f5-5251-4d0e-bad9-28acd5fcc8b6 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:21.555262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-bac21704-0cce-4f64-a4f1-8f62c40663e1 req-3d7214f5-5251-4d0e-bad9-28acd5fcc8b6 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:21.555840 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-bac21704-0cce-4f64-a4f1-8f62c40663e1 req-3d7214f5-5251-4d0e-bad9-28acd5fcc8b6 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:21.576114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-bac21704-0cce-4f64-a4f1-8f62c40663e1 req-3d7214f5-5251-4d0e-bad9-28acd5fcc8b6 service nova] Creating event network-vif-plugged:b58125e8-2973-41d3-8208-c72a7386dd43 for instance 2ca57bbc-68ea-4114-a936-36f8ef102682 on hv-cinder-85144 Aug 26 15:58:21.582468 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-bac21704-0cce-4f64-a4f1-8f62c40663e1 req-3d7214f5-5251-4d0e-bad9-28acd5fcc8b6 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048007 Aug 26 15:58:21.583442 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 115/247] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 15:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:58:21.584647 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-e3c31adb-8b10-4afb-86ad-2d92ed21fe65 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:21.594263 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-e3c31adb-8b10-4afb-86ad-2d92ed21fe65 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682" status: 200 len: 1313 microversion: 2.1 time: 0.177242 Aug 26 15:58:21.595060 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 133/248] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:21 2022] GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:22.242440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-42ab58c5-ce28-425c-9ec0-7a8f49743771 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:22.243793 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-42ab58c5-ce28-425c-9ec0-7a8f49743771 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:22.250662 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42ab58c5-ce28-425c-9ec0-7a8f49743771 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:22.254280 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42ab58c5-ce28-425c-9ec0-7a8f49743771 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:22.254280 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42ab58c5-ce28-425c-9ec0-7a8f49743771 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:22.254280 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42ab58c5-ce28-425c-9ec0-7a8f49743771 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:22.254280 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42ab58c5-ce28-425c-9ec0-7a8f49743771 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:22.254638 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42ab58c5-ce28-425c-9ec0-7a8f49743771 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:22.431413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-42ab58c5-ce28-425c-9ec0-7a8f49743771 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:22.443540 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-42ab58c5-ce28-425c-9ec0-7a8f49743771 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1503 microversion: 2.1 time: 0.205772 Aug 26 15:58:22.444787 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 116/249] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:22 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1503 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:22.472314 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-63e5f2c2-5edd-4468-9dc4-c80d316a2297 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:22.472925 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-63e5f2c2-5edd-4468-9dc4-c80d316a2297 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:22.479379 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63e5f2c2-5edd-4468-9dc4-c80d316a2297 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:22.480095 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63e5f2c2-5edd-4468-9dc4-c80d316a2297 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:22.480738 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63e5f2c2-5edd-4468-9dc4-c80d316a2297 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:22.481439 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63e5f2c2-5edd-4468-9dc4-c80d316a2297 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:22.481894 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63e5f2c2-5edd-4468-9dc4-c80d316a2297 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:22.482326 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63e5f2c2-5edd-4468-9dc4-c80d316a2297 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:22.529662 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-c9c09068-06fb-45ba-bc68-1853d80ce4d6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-717974835", "imageRef": "bcbdbb0c-7335-4427-a636-e2dc730274b6", "flavorRef": "452", "networks": [{"uuid": "93d3cdba-46e7-400a-a999-4977612a2c5c"}]}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:58:22.592464 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.network.neutron [None req-c9c09068-06fb-45ba-bc68-1853d80ce4d6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] validate_networks() for [('93d3cdba-46e7-400a-a999-4977612a2c5c', None, None, None, None, None)] {{(pid=128304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:58:22.682642 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-63e5f2c2-5edd-4468-9dc4-c80d316a2297 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:22.691176 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-63e5f2c2-5edd-4468-9dc4-c80d316a2297 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1516 microversion: 2.1 time: 0.222882 Aug 26 15:58:22.691835 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 134/250] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:22 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1516 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:22.696269 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-3ffe1245-c2ea-495a-9b4a-e626ce6a7805 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:22.696945 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-3ffe1245-c2ea-495a-9b4a-e626ce6a7805 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 2ca57bbc-68ea-4114-a936-36f8ef102682] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:22.703107 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3ffe1245-c2ea-495a-9b4a-e626ce6a7805 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:22.703770 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3ffe1245-c2ea-495a-9b4a-e626ce6a7805 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:22.704300 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3ffe1245-c2ea-495a-9b4a-e626ce6a7805 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:22.705073 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3ffe1245-c2ea-495a-9b4a-e626ce6a7805 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:22.705599 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3ffe1245-c2ea-495a-9b4a-e626ce6a7805 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:22.706095 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3ffe1245-c2ea-495a-9b4a-e626ce6a7805 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:23.175571 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-3ffe1245-c2ea-495a-9b4a-e626ce6a7805 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:23.183197 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-3ffe1245-c2ea-495a-9b4a-e626ce6a7805 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682" status: 200 len: 1313 microversion: 2.1 time: 0.490305 Aug 26 15:58:23.183769 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 135/251] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:22 2022] GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682 => generated 1313 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:23.293467 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-c9c09068-06fb-45ba-bc68-1853d80ce4d6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Flavor limits 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:58:23.293940 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-c9c09068-06fb-45ba-bc68-1853d80ce4d6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Image limits 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:58:23.294429 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-c9c09068-06fb-45ba-bc68-1853d80ce4d6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Flavor pref 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:58:23.294763 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-c9c09068-06fb-45ba-bc68-1853d80ce4d6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Image pref 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:58:23.295238 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-c9c09068-06fb-45ba-bc68-1853d80ce4d6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:58:23.304493 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c9c09068-06fb-45ba-bc68-1853d80ce4d6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:23.304862 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c9c09068-06fb-45ba-bc68-1853d80ce4d6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:23.305291 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c9c09068-06fb-45ba-bc68-1853d80ce4d6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:23.306091 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c9c09068-06fb-45ba-bc68-1853d80ce4d6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:23.306519 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c9c09068-06fb-45ba-bc68-1853d80ce4d6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:23.306965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c9c09068-06fb-45ba-bc68-1853d80ce4d6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:23.323685 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-c9c09068-06fb-45ba-bc68-1853d80ce4d6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Getting quotas for project f3a9b259e9d54603af734306adbfe16c. Resources: {'instances', 'ram', 'cores'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:58:23.328450 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-c9c09068-06fb-45ba-bc68-1853d80ce4d6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Getting quotas for user a0ecfd3d64ba4fef820a31b1522125ff and project f3a9b259e9d54603af734306adbfe16c. Resources: {'instances', 'ram', 'cores'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:58:23.340021 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-c9c09068-06fb-45ba-bc68-1853d80ce4d6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Going to run 1 instances... {{(pid=128304) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:58:23.344921 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-c9c09068-06fb-45ba-bc68-1853d80ce4d6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 98316258-36ac-4e26-b92d-48fc237b5818] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bcbdbb0c-7335-4427-a636-e2dc730274b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:58:23.513413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-c9c09068-06fb-45ba-bc68-1853d80ce4d6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.988244 Aug 26 15:58:23.514288 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 117/252] 10.222.0.94 () {60 vars in 1147 bytes} [Fri Aug 26 15:58:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 15:58:23.527126 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-80a731af-4b30-43f9-92ff-dd590e01db6f tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:23.528883 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-80a731af-4b30-43f9-92ff-dd590e01db6f tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 98316258-36ac-4e26-b92d-48fc237b5818] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:23.602848 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-80a731af-4b30-43f9-92ff-dd590e01db6f tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:23.609950 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-80a731af-4b30-43f9-92ff-dd590e01db6f tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818" status: 200 len: 1218 microversion: 2.1 time: 0.087195 Aug 26 15:58:23.610538 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 136/253] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:23 2022] GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:24.204800 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f033d12a-d486-4f9d-86f9-4fc7b5c29224 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:24.205474 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-f033d12a-d486-4f9d-86f9-4fc7b5c29224 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 2ca57bbc-68ea-4114-a936-36f8ef102682] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:24.212487 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f033d12a-d486-4f9d-86f9-4fc7b5c29224 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:24.212968 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f033d12a-d486-4f9d-86f9-4fc7b5c29224 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:24.213404 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f033d12a-d486-4f9d-86f9-4fc7b5c29224 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:24.214097 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f033d12a-d486-4f9d-86f9-4fc7b5c29224 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:24.214867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f033d12a-d486-4f9d-86f9-4fc7b5c29224 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:24.215336 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f033d12a-d486-4f9d-86f9-4fc7b5c29224 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:24.346438 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-f033d12a-d486-4f9d-86f9-4fc7b5c29224 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:24.354489 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-f033d12a-d486-4f9d-86f9-4fc7b5c29224 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682" status: 200 len: 1498 microversion: 2.1 time: 0.154242 Aug 26 15:58:24.355177 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 118/254] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:24 2022] GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682 => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:24.633571 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-920d46e5-08b0-49fb-a4ce-1569fb4b95a4 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:24.634171 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-920d46e5-08b0-49fb-a4ce-1569fb4b95a4 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 98316258-36ac-4e26-b92d-48fc237b5818] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:24.689490 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-920d46e5-08b0-49fb-a4ce-1569fb4b95a4 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:24.694473 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-6b50b4ac-b589-40c7-a3b3-199982946611 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:58:24.696984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-6b50b4ac-b589-40c7-a3b3-199982946611 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:24.698118 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-920d46e5-08b0-49fb-a4ce-1569fb4b95a4 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818" status: 200 len: 1218 microversion: 2.1 time: 0.068276 Aug 26 15:58:24.699138 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 137/255] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:24 2022] GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:24.716541 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6b50b4ac-b589-40c7-a3b3-199982946611 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:24.721011 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6b50b4ac-b589-40c7-a3b3-199982946611 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:24.721011 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6b50b4ac-b589-40c7-a3b3-199982946611 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:24.721011 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6b50b4ac-b589-40c7-a3b3-199982946611 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:24.721011 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6b50b4ac-b589-40c7-a3b3-199982946611 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:24.721447 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6b50b4ac-b589-40c7-a3b3-199982946611 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:24.750672 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.objects.instance [None req-6b50b4ac-b589-40c7-a3b3-199982946611 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lazy-loading 'flavor' on Instance uuid 18a7ee09-cb33-4638-a620-e36bc333cec6 {{(pid=128304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:58:25.191702 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-6b50b4ac-b589-40c7-a3b3-199982946611 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "POST /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6/action" status: 200 len: 32 microversion: 2.1 time: 0.501382 Aug 26 15:58:25.192497 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 119/256] 10.222.0.94 () {60 vars in 1278 bytes} [Fri Aug 26 15:58:24 2022] POST /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6/action => generated 32 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 15:58:25.203506 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-8412139e-1dca-487c-a9d1-c305591e9228 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:25.203506 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-8412139e-1dca-487c-a9d1-c305591e9228 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:25.210947 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8412139e-1dca-487c-a9d1-c305591e9228 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:25.211435 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8412139e-1dca-487c-a9d1-c305591e9228 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:25.211876 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8412139e-1dca-487c-a9d1-c305591e9228 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:25.212608 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8412139e-1dca-487c-a9d1-c305591e9228 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:25.213064 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8412139e-1dca-487c-a9d1-c305591e9228 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:25.213490 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8412139e-1dca-487c-a9d1-c305591e9228 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:25.353066 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-8412139e-1dca-487c-a9d1-c305591e9228 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:25.361773 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-8412139e-1dca-487c-a9d1-c305591e9228 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.163524 Aug 26 15:58:25.362364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 138/257] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:25 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:25.722113 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-0ad5e0d2-6808-4d09-a3f5-97144f1fff5f tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:25.723516 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-0ad5e0d2-6808-4d09-a3f5-97144f1fff5f tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 98316258-36ac-4e26-b92d-48fc237b5818] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:25.729926 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0ad5e0d2-6808-4d09-a3f5-97144f1fff5f tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:25.730957 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0ad5e0d2-6808-4d09-a3f5-97144f1fff5f tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:25.731602 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0ad5e0d2-6808-4d09-a3f5-97144f1fff5f tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:25.732454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0ad5e0d2-6808-4d09-a3f5-97144f1fff5f tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:25.733192 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0ad5e0d2-6808-4d09-a3f5-97144f1fff5f tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:25.733794 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0ad5e0d2-6808-4d09-a3f5-97144f1fff5f tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:25.835402 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-2b59b9c8-d7f6-4d85-8a05-b2ba3e6eb7ba tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:25.836055 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-2b59b9c8-d7f6-4d85-8a05-b2ba3e6eb7ba tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 2ca57bbc-68ea-4114-a936-36f8ef102682] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:25.840409 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-0ad5e0d2-6808-4d09-a3f5-97144f1fff5f tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:25.851265 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:25.856877 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2b59b9c8-d7f6-4d85-8a05-b2ba3e6eb7ba tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:25.857972 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-0ad5e0d2-6808-4d09-a3f5-97144f1fff5f tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818" status: 200 len: 1214 microversion: 2.1 time: 0.140606 Aug 26 15:58:25.859472 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2b59b9c8-d7f6-4d85-8a05-b2ba3e6eb7ba tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:25.860016 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 120/258] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:25 2022] GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818 => generated 1214 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:25.860671 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2b59b9c8-d7f6-4d85-8a05-b2ba3e6eb7ba tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:25.861687 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2b59b9c8-d7f6-4d85-8a05-b2ba3e6eb7ba tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:25.862362 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2b59b9c8-d7f6-4d85-8a05-b2ba3e6eb7ba tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:25.863079 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2b59b9c8-d7f6-4d85-8a05-b2ba3e6eb7ba tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:25.893133 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-2b59b9c8-d7f6-4d85-8a05-b2ba3e6eb7ba tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 2ca57bbc-68ea-4114-a936-36f8ef102682] Going to try to terminate instance {{(pid=128305) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 15:58:26.267241 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-2b59b9c8-d7f6-4d85-8a05-b2ba3e6eb7ba tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "DELETE /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682" status: 204 len: 0 microversion: 2.1 time: 0.435796 Aug 26 15:58:26.267831 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 139/259] 10.222.0.94 () {58 vars in 1239 bytes} [Fri Aug 26 15:58:25 2022] DELETE /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 15:58:26.275975 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-dcfc8c73-d16e-4409-8881-8e87e67df7ba tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:26.276559 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-dcfc8c73-d16e-4409-8881-8e87e67df7ba tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 2ca57bbc-68ea-4114-a936-36f8ef102682] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:26.283541 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-dcfc8c73-d16e-4409-8881-8e87e67df7ba tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:26.284032 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-dcfc8c73-d16e-4409-8881-8e87e67df7ba tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:26.284476 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-dcfc8c73-d16e-4409-8881-8e87e67df7ba tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:26.285179 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-dcfc8c73-d16e-4409-8881-8e87e67df7ba tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:26.285627 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-dcfc8c73-d16e-4409-8881-8e87e67df7ba tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:26.286056 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-dcfc8c73-d16e-4409-8881-8e87e67df7ba tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:26.390513 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-77639414-5160-4d6a-a245-15276743b9d7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:26.391370 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-77639414-5160-4d6a-a245-15276743b9d7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:26.405218 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-77639414-5160-4d6a-a245-15276743b9d7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:26.405885 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-77639414-5160-4d6a-a245-15276743b9d7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:26.406240 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-77639414-5160-4d6a-a245-15276743b9d7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:26.407058 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-77639414-5160-4d6a-a245-15276743b9d7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:26.407520 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-77639414-5160-4d6a-a245-15276743b9d7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:26.408000 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-77639414-5160-4d6a-a245-15276743b9d7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:26.426239 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:26.440265 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-dcfc8c73-d16e-4409-8881-8e87e67df7ba tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:26.448093 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-dcfc8c73-d16e-4409-8881-8e87e67df7ba tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682" status: 200 len: 1504 microversion: 2.1 time: 0.175968 Aug 26 15:58:26.456269 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 121/260] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:26 2022] GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:26.570477 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-77639414-5160-4d6a-a245-15276743b9d7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:26.583264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-77639414-5160-4d6a-a245-15276743b9d7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.202680 Aug 26 15:58:26.595042 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 140/261] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:26 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:26.880816 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-2885a501-9074-4aec-9d8d-bdcf8094f21c tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:26.881424 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-2885a501-9074-4aec-9d8d-bdcf8094f21c tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 98316258-36ac-4e26-b92d-48fc237b5818] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:26.888572 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2885a501-9074-4aec-9d8d-bdcf8094f21c tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:26.889048 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2885a501-9074-4aec-9d8d-bdcf8094f21c tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:26.889487 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2885a501-9074-4aec-9d8d-bdcf8094f21c tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:26.890186 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2885a501-9074-4aec-9d8d-bdcf8094f21c tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:26.890639 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2885a501-9074-4aec-9d8d-bdcf8094f21c tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:26.891108 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2885a501-9074-4aec-9d8d-bdcf8094f21c tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:26.957681 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-2885a501-9074-4aec-9d8d-bdcf8094f21c tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:26.965862 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-2885a501-9074-4aec-9d8d-bdcf8094f21c tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818" status: 200 len: 1270 microversion: 2.1 time: 0.089108 Aug 26 15:58:26.966579 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 122/262] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:26 2022] GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818 => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:27.476165 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-40dd14ae-a736-4595-96ca-1f54ba8252dc tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:27.476886 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-40dd14ae-a736-4595-96ca-1f54ba8252dc tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 2ca57bbc-68ea-4114-a936-36f8ef102682] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:27.483809 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-40dd14ae-a736-4595-96ca-1f54ba8252dc tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:27.484288 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-40dd14ae-a736-4595-96ca-1f54ba8252dc tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:27.484715 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-40dd14ae-a736-4595-96ca-1f54ba8252dc tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:27.485399 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-40dd14ae-a736-4595-96ca-1f54ba8252dc tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:27.485844 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-40dd14ae-a736-4595-96ca-1f54ba8252dc tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:27.486262 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-40dd14ae-a736-4595-96ca-1f54ba8252dc tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:27.604369 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-da06930e-3619-437d-a367-36b1f61140b1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:27.605563 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-da06930e-3619-437d-a367-36b1f61140b1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:27.611792 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-da06930e-3619-437d-a367-36b1f61140b1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:27.612281 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-da06930e-3619-437d-a367-36b1f61140b1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:27.612753 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-da06930e-3619-437d-a367-36b1f61140b1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:27.613476 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-da06930e-3619-437d-a367-36b1f61140b1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:27.613929 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-da06930e-3619-437d-a367-36b1f61140b1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:27.614356 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-da06930e-3619-437d-a367-36b1f61140b1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:27.629106 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-40dd14ae-a736-4595-96ca-1f54ba8252dc tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:27.637636 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-40dd14ae-a736-4595-96ca-1f54ba8252dc tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682" status: 200 len: 1504 microversion: 2.1 time: 0.165381 Aug 26 15:58:27.642262 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 141/263] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:27 2022] GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:27.883546 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-da06930e-3619-437d-a367-36b1f61140b1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:27.893060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-da06930e-3619-437d-a367-36b1f61140b1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.292658 Aug 26 15:58:27.893633 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 123/264] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:27 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:27.986463 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-22f4e55f-27da-4471-b14f-8b2a93438b81 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:27.987117 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-22f4e55f-27da-4471-b14f-8b2a93438b81 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 98316258-36ac-4e26-b92d-48fc237b5818] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:27.993156 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-22f4e55f-27da-4471-b14f-8b2a93438b81 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:27.993639 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-22f4e55f-27da-4471-b14f-8b2a93438b81 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:27.994095 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-22f4e55f-27da-4471-b14f-8b2a93438b81 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:27.994790 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-22f4e55f-27da-4471-b14f-8b2a93438b81 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:27.995303 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-22f4e55f-27da-4471-b14f-8b2a93438b81 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:27.996283 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-22f4e55f-27da-4471-b14f-8b2a93438b81 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:28.057573 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-22f4e55f-27da-4471-b14f-8b2a93438b81 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:28.066025 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-22f4e55f-27da-4471-b14f-8b2a93438b81 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818" status: 200 len: 1270 microversion: 2.1 time: 0.083267 Aug 26 15:58:28.066798 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 142/265] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:27 2022] GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818 => generated 1270 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:28.658787 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-6c6b726f-cdc6-4e01-81cd-322ba98e9951 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:28.659437 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-6c6b726f-cdc6-4e01-81cd-322ba98e9951 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 2ca57bbc-68ea-4114-a936-36f8ef102682] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:28.665313 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6c6b726f-cdc6-4e01-81cd-322ba98e9951 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:28.665741 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6c6b726f-cdc6-4e01-81cd-322ba98e9951 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:28.666182 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6c6b726f-cdc6-4e01-81cd-322ba98e9951 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:28.666884 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6c6b726f-cdc6-4e01-81cd-322ba98e9951 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:28.667861 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6c6b726f-cdc6-4e01-81cd-322ba98e9951 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:28.668440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6c6b726f-cdc6-4e01-81cd-322ba98e9951 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:28.804473 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-6c6b726f-cdc6-4e01-81cd-322ba98e9951 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:28.812078 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-6c6b726f-cdc6-4e01-81cd-322ba98e9951 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682" status: 200 len: 1504 microversion: 2.1 time: 0.157234 Aug 26 15:58:28.812642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 124/266] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:28 2022] GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:28.914330 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-d8a6d2ee-d023-477e-8aa8-a289d91837bd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:28.914962 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-d8a6d2ee-d023-477e-8aa8-a289d91837bd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:28.922387 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d8a6d2ee-d023-477e-8aa8-a289d91837bd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:28.922774 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d8a6d2ee-d023-477e-8aa8-a289d91837bd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:28.923243 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d8a6d2ee-d023-477e-8aa8-a289d91837bd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:28.923940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d8a6d2ee-d023-477e-8aa8-a289d91837bd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:28.924390 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d8a6d2ee-d023-477e-8aa8-a289d91837bd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:28.924813 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d8a6d2ee-d023-477e-8aa8-a289d91837bd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:29.088353 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-4d50cde8-e6bb-4bf3-b3a0-890815ed240e tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:29.089358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-4d50cde8-e6bb-4bf3-b3a0-890815ed240e tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 98316258-36ac-4e26-b92d-48fc237b5818] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:29.096483 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4d50cde8-e6bb-4bf3-b3a0-890815ed240e tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:29.096971 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4d50cde8-e6bb-4bf3-b3a0-890815ed240e tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:29.097406 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4d50cde8-e6bb-4bf3-b3a0-890815ed240e tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:29.098108 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4d50cde8-e6bb-4bf3-b3a0-890815ed240e tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:29.098557 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4d50cde8-e6bb-4bf3-b3a0-890815ed240e tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:29.099013 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4d50cde8-e6bb-4bf3-b3a0-890815ed240e tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:29.186913 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-4d50cde8-e6bb-4bf3-b3a0-890815ed240e tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:29.195990 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d8a6d2ee-d023-477e-8aa8-a289d91837bd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:29.206320 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-d8a6d2ee-d023-477e-8aa8-a289d91837bd tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.296411 Aug 26 15:58:29.207514 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 143/267] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:28 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:29.219700 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-4d50cde8-e6bb-4bf3-b3a0-890815ed240e tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818" status: 200 len: 1270 microversion: 2.1 time: 0.122534 Aug 26 15:58:29.220554 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 125/268] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:29 2022] GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818 => generated 1270 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:29.550554 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-0b158762-7d2c-4721-97b2-2c6758f4a8f3 req-7097ad8b-8d8e-4f0b-a0a6-940a26f3294c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca57bbc-68ea-4114-a936-36f8ef102682", "name": "network-vif-deleted", "tag": "b58125e8-2973-41d3-8208-c72a7386dd43"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:58:29.563364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-0b158762-7d2c-4721-97b2-2c6758f4a8f3 req-7097ad8b-8d8e-4f0b-a0a6-940a26f3294c service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:29.564312 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-0b158762-7d2c-4721-97b2-2c6758f4a8f3 req-7097ad8b-8d8e-4f0b-a0a6-940a26f3294c service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:29.564956 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-0b158762-7d2c-4721-97b2-2c6758f4a8f3 req-7097ad8b-8d8e-4f0b-a0a6-940a26f3294c service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:29.580611 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-0b158762-7d2c-4721-97b2-2c6758f4a8f3 req-7097ad8b-8d8e-4f0b-a0a6-940a26f3294c service nova] Creating event network-vif-deleted:b58125e8-2973-41d3-8208-c72a7386dd43 for instance 2ca57bbc-68ea-4114-a936-36f8ef102682 on hv-cinder-85144 Aug 26 15:58:29.586374 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-0b158762-7d2c-4721-97b2-2c6758f4a8f3 req-7097ad8b-8d8e-4f0b-a0a6-940a26f3294c service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039795 Aug 26 15:58:29.587286 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 144/269] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 15:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:58:29.833671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ba55c25b-9bc2-4cd5-acad-ebf629ee321c tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:29.834537 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ba55c25b-9bc2-4cd5-acad-ebf629ee321c tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 2ca57bbc-68ea-4114-a936-36f8ef102682] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:29.840888 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba55c25b-9bc2-4cd5-acad-ebf629ee321c tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:29.841603 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba55c25b-9bc2-4cd5-acad-ebf629ee321c tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:29.842201 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba55c25b-9bc2-4cd5-acad-ebf629ee321c tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:29.842909 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba55c25b-9bc2-4cd5-acad-ebf629ee321c tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:29.843468 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba55c25b-9bc2-4cd5-acad-ebf629ee321c tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:29.843864 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba55c25b-9bc2-4cd5-acad-ebf629ee321c tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:29.929164 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-ba55c25b-9bc2-4cd5-acad-ebf629ee321c tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:29.940127 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ba55c25b-9bc2-4cd5-acad-ebf629ee321c tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682" status: 200 len: 1298 microversion: 2.1 time: 0.110134 Aug 26 15:58:29.940974 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 126/270] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:29 2022] GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682 => generated 1298 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:30.239967 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-ec70723f-6291-4ccf-becb-8edd766c996d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:30.240588 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-ec70723f-6291-4ccf-becb-8edd766c996d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:30.242220 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-348bd0f1-6280-48d3-9461-6a94905d429a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:30.242832 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-348bd0f1-6280-48d3-9461-6a94905d429a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 98316258-36ac-4e26-b92d-48fc237b5818] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:30.247030 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ec70723f-6291-4ccf-becb-8edd766c996d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:30.247504 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ec70723f-6291-4ccf-becb-8edd766c996d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:30.247930 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ec70723f-6291-4ccf-becb-8edd766c996d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:30.248614 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ec70723f-6291-4ccf-becb-8edd766c996d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:30.249053 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ec70723f-6291-4ccf-becb-8edd766c996d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:30.249341 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-348bd0f1-6280-48d3-9461-6a94905d429a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:30.249468 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ec70723f-6291-4ccf-becb-8edd766c996d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:30.249828 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-348bd0f1-6280-48d3-9461-6a94905d429a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:30.250293 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-348bd0f1-6280-48d3-9461-6a94905d429a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:30.259151 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-348bd0f1-6280-48d3-9461-6a94905d429a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:30.259865 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-348bd0f1-6280-48d3-9461-6a94905d429a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:30.260343 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-348bd0f1-6280-48d3-9461-6a94905d429a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:30.489746 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-348bd0f1-6280-48d3-9461-6a94905d429a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:30.501250 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-ec70723f-6291-4ccf-becb-8edd766c996d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:30.501859 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-348bd0f1-6280-48d3-9461-6a94905d429a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818" status: 200 len: 1318 microversion: 2.1 time: 0.260159 Aug 26 15:58:30.501859 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 127/271] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:30 2022] GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:30.502130 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-ec70723f-6291-4ccf-becb-8edd766c996d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.266162 Aug 26 15:58:30.502392 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 145/272] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:30 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:30.962945 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-134bae8d-9afe-49fb-828e-c436aae996c8 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:30.963675 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-134bae8d-9afe-49fb-828e-c436aae996c8 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 2ca57bbc-68ea-4114-a936-36f8ef102682] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:30.971301 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-134bae8d-9afe-49fb-828e-c436aae996c8 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:30.972691 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-134bae8d-9afe-49fb-828e-c436aae996c8 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:30.973305 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-134bae8d-9afe-49fb-828e-c436aae996c8 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:30.974092 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-134bae8d-9afe-49fb-828e-c436aae996c8 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:30.974635 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-134bae8d-9afe-49fb-828e-c436aae996c8 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:30.975412 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-134bae8d-9afe-49fb-828e-c436aae996c8 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:31.015986 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-134bae8d-9afe-49fb-828e-c436aae996c8 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:31.016525 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-134bae8d-9afe-49fb-828e-c436aae996c8 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:31.016971 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-134bae8d-9afe-49fb-828e-c436aae996c8 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:31.017452 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.objects.instance [None req-134bae8d-9afe-49fb-828e-c436aae996c8 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lazy-loading 'fault' on Instance uuid 2ca57bbc-68ea-4114-a936-36f8ef102682 {{(pid=128304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:58:31.070668 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-134bae8d-9afe-49fb-828e-c436aae996c8 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:31.089854 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-134bae8d-9afe-49fb-828e-c436aae996c8 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682" status: 200 len: 1303 microversion: 2.1 time: 0.124985 Aug 26 15:58:31.089854 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 128/273] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:30 2022] GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682 => generated 1303 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:31.410016 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-440bbafd-6e3c-4a80-8cba-6d46b3761ed5 req-5a8b5ab5-606c-4fa1-91ea-8d0952140b74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98316258-36ac-4e26-b92d-48fc237b5818", "tag": "e7d4227b-1c33-41ac-a99b-20b0fcfca9cc"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:58:31.425017 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-440bbafd-6e3c-4a80-8cba-6d46b3761ed5 req-5a8b5ab5-606c-4fa1-91ea-8d0952140b74 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:31.425500 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-440bbafd-6e3c-4a80-8cba-6d46b3761ed5 req-5a8b5ab5-606c-4fa1-91ea-8d0952140b74 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:31.426978 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-440bbafd-6e3c-4a80-8cba-6d46b3761ed5 req-5a8b5ab5-606c-4fa1-91ea-8d0952140b74 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:31.439838 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-440bbafd-6e3c-4a80-8cba-6d46b3761ed5 req-5a8b5ab5-606c-4fa1-91ea-8d0952140b74 service nova] Creating event network-changed:e7d4227b-1c33-41ac-a99b-20b0fcfca9cc for instance 98316258-36ac-4e26-b92d-48fc237b5818 on hv-cinder-85144 Aug 26 15:58:31.444651 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-440bbafd-6e3c-4a80-8cba-6d46b3761ed5 req-5a8b5ab5-606c-4fa1-91ea-8d0952140b74 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040102 Aug 26 15:58:31.445514 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 146/274] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 15:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:58:31.520138 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-65452d23-38f2-4ccb-a4b6-0d58367529a3 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:31.521017 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-65452d23-38f2-4ccb-a4b6-0d58367529a3 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 98316258-36ac-4e26-b92d-48fc237b5818] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:31.523421 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:31.523991 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-46805f31-d4e7-4ce4-b595-83946f79b4aa tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:31.524680 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-46805f31-d4e7-4ce4-b595-83946f79b4aa tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:31.529561 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-65452d23-38f2-4ccb-a4b6-0d58367529a3 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:31.530113 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-65452d23-38f2-4ccb-a4b6-0d58367529a3 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:31.530545 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-65452d23-38f2-4ccb-a4b6-0d58367529a3 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:31.531420 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-65452d23-38f2-4ccb-a4b6-0d58367529a3 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:31.531873 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-65452d23-38f2-4ccb-a4b6-0d58367529a3 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:31.532217 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-46805f31-d4e7-4ce4-b595-83946f79b4aa tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:31.532319 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-65452d23-38f2-4ccb-a4b6-0d58367529a3 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:31.532710 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-46805f31-d4e7-4ce4-b595-83946f79b4aa tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:31.533125 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-46805f31-d4e7-4ce4-b595-83946f79b4aa tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:31.533810 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-46805f31-d4e7-4ce4-b595-83946f79b4aa tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:31.534254 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-46805f31-d4e7-4ce4-b595-83946f79b4aa tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:31.534857 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-46805f31-d4e7-4ce4-b595-83946f79b4aa tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:31.702395 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-65452d23-38f2-4ccb-a4b6-0d58367529a3 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:31.710534 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-65452d23-38f2-4ccb-a4b6-0d58367529a3 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818" status: 200 len: 1318 microversion: 2.1 time: 0.194391 Aug 26 15:58:31.711275 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 129/275] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:31 2022] GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:31.829873 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-46805f31-d4e7-4ce4-b595-83946f79b4aa tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:31.837949 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-46805f31-d4e7-4ce4-b595-83946f79b4aa tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.318079 Aug 26 15:58:31.838521 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 147/276] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:31 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:32.107376 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-9997d173-5bd3-4f96-8b43-f40e8b063b00 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:32.108588 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-9997d173-5bd3-4f96-8b43-f40e8b063b00 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 2ca57bbc-68ea-4114-a936-36f8ef102682] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:32.114889 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9997d173-5bd3-4f96-8b43-f40e8b063b00 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:32.115555 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9997d173-5bd3-4f96-8b43-f40e8b063b00 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:32.115993 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9997d173-5bd3-4f96-8b43-f40e8b063b00 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:32.116799 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9997d173-5bd3-4f96-8b43-f40e8b063b00 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:32.117350 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9997d173-5bd3-4f96-8b43-f40e8b063b00 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:32.117824 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9997d173-5bd3-4f96-8b43-f40e8b063b00 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:32.132878 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-9997d173-5bd3-4f96-8b43-f40e8b063b00 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] HTTP exception thrown: Instance 2ca57bbc-68ea-4114-a936-36f8ef102682 could not be found. Aug 26 15:58:32.134544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-9997d173-5bd3-4f96-8b43-f40e8b063b00 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Request method failure captured: Aug 26 15:58:32.134544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682 HTTP/1.1 Aug 26 15:58:32.134544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 15:58:32.134544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 15:58:32.134544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 15:58:32.134544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 0 Aug 26 15:58:32.134544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 15:58:32.134544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 15:58:32.134544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 15:58:32.134544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 15:58:32.134544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO2HtEBtYidKC0yaENr7iF8WVU36omnMdJEd6RS-9GkPRYe8311G1iTVk8hCfuJP8S_8SiVnovHOJnqbpj9oW2SPe0xUeDaluoz_wDml-BXu5UpBfL7PNh0KPwVE2jAW5B_CYtFSR8K48ydwAWOQwZZqI0mh2kCdaW8RjefwBno9oXE Aug 26 15:58:32.134544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 15:58:32.134544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 15:58:32.134544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 15:58:32.134544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 15:58:32.134544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 15:58:32.134544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 15:58:32.134544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: 2ff1702cbe6d41b196df47d78f148368 Aug 26 15:58:32.134544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-VolumesActionsTest-2123347964 Aug 26 15:58:32.134544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 15:58:32.134544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 15:58:32.136730 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/2ff1702cbe6d41b196df47d78f148368"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/2ff1702cbe6d41b196df47d78f148368"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/2ff1702cbe6d41b196df47d78f148368"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_2ff1702cbe6d41b196df47d78f148368", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 15:58:32.136730 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-VolumesActionsTest-2123347964 Aug 26 15:58:32.136730 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: 2ff1702cbe6d41b196df47d78f148368 Aug 26 15:58:32.136730 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-VolumesActionsTest-2123347964 Aug 26 15:58:32.136730 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-VolumesActionsTest-2123347964-project Aug 26 15:58:32.136730 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 15:58:32.136730 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 15:58:32.136730 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: abe845d55b4b4ac898556dbdc264c086 Aug 26 15:58:32.136730 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-VolumesActionsTest-2123347964-project Aug 26 15:58:32.136730 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: > Aug 26 15:58:32.136730 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Instance 2ca57bbc-68ea-4114-a936-36f8ef102682 could not be found. Aug 26 15:58:32.136730 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'id': '2ca57bbc-68ea-4114-a936-36f8ef102682'} Aug 26 15:58:32.140994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:58:32.140994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:32.140994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:58:32.140994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:58:32.140994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:58:32.140994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:58:32.140994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:58:32.140994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:58:32.140994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:58:32.140994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:58:32.140994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ca57bbc-68ea-4114-a936-36f8ef102682 could not be found. Aug 26 15:58:32.140994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 15:58:32.140994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:32.140994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 15:58:32.140994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:32.140994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:32.140994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:32.140994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:58:32.140994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:58:32.140994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:58:32.142495 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:58:32.142495 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 15:58:32.142495 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 15:58:32.142495 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:58:32.142495 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:58:32.142495 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:58:32.142495 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:58:32.142495 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ca57bbc-68ea-4114-a936-36f8ef102682 could not be found. Aug 26 15:58:32.142495 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 15:58:32.142495 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:32.142495 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 15:58:32.142495 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:32.142495 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:32.142495 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:32.142495 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:58:32.142495 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:58:32.142495 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ca57bbc-68ea-4114-a936-36f8ef102682 could not be found. Aug 26 15:58:32.142495 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 15:58:32.145375 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-9997d173-5bd3-4f96-8b43-f40e8b063b00 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Returning 404 to user: Instance 2ca57bbc-68ea-4114-a936-36f8ef102682 could not be found. {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:58:32.145375 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-9997d173-5bd3-4f96-8b43-f40e8b063b00 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682" status: 404 len: 111 microversion: 2.1 time: 0.033092 Aug 26 15:58:32.145375 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 130/277] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:32 2022] GET /compute/v2.1/servers/2ca57bbc-68ea-4114-a936-36f8ef102682 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:58:32.265908 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-dc21b4f9-8c53-4147-9fcd-e0e8e3d813b0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1098542297", "imageRef": "bcbdbb0c-7335-4427-a636-e2dc730274b6", "flavorRef": "452", "networks": [{"uuid": "896b40d0-f5e7-4bb6-9611-c340591fa457"}]}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:58:32.324713 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.network.neutron [None req-dc21b4f9-8c53-4147-9fcd-e0e8e3d813b0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] validate_networks() for [('896b40d0-f5e7-4bb6-9611-c340591fa457', None, None, None, None, None)] {{(pid=128305) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:58:32.685499 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-dc21b4f9-8c53-4147-9fcd-e0e8e3d813b0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Flavor limits 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:58:32.686005 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-dc21b4f9-8c53-4147-9fcd-e0e8e3d813b0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Image limits 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:58:32.686368 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-dc21b4f9-8c53-4147-9fcd-e0e8e3d813b0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Flavor pref 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:58:32.686764 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-dc21b4f9-8c53-4147-9fcd-e0e8e3d813b0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Image pref 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:58:32.687257 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-dc21b4f9-8c53-4147-9fcd-e0e8e3d813b0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:58:32.696036 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dc21b4f9-8c53-4147-9fcd-e0e8e3d813b0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:32.696505 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dc21b4f9-8c53-4147-9fcd-e0e8e3d813b0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:32.696928 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dc21b4f9-8c53-4147-9fcd-e0e8e3d813b0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:32.697634 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dc21b4f9-8c53-4147-9fcd-e0e8e3d813b0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:32.698074 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dc21b4f9-8c53-4147-9fcd-e0e8e3d813b0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:32.698491 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dc21b4f9-8c53-4147-9fcd-e0e8e3d813b0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:32.715766 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-dc21b4f9-8c53-4147-9fcd-e0e8e3d813b0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Getting quotas for project 2ff1702cbe6d41b196df47d78f148368. Resources: {'instances', 'ram', 'cores'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:58:32.719650 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-dc21b4f9-8c53-4147-9fcd-e0e8e3d813b0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Getting quotas for user abe845d55b4b4ac898556dbdc264c086 and project 2ff1702cbe6d41b196df47d78f148368. Resources: {'instances', 'ram', 'cores'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:58:32.731894 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-dc21b4f9-8c53-4147-9fcd-e0e8e3d813b0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Going to run 1 instances... {{(pid=128305) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:58:32.733197 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-3af38d00-64c6-427e-8a00-a637412f2753 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:32.733813 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-3af38d00-64c6-427e-8a00-a637412f2753 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 98316258-36ac-4e26-b92d-48fc237b5818] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:32.734198 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-dc21b4f9-8c53-4147-9fcd-e0e8e3d813b0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 33640225-7b6b-41b9-af71-b8698d9b9764] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bcbdbb0c-7335-4427-a636-e2dc730274b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128305) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:58:32.740898 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3af38d00-64c6-427e-8a00-a637412f2753 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:32.741316 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3af38d00-64c6-427e-8a00-a637412f2753 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:32.741855 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3af38d00-64c6-427e-8a00-a637412f2753 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:32.742486 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3af38d00-64c6-427e-8a00-a637412f2753 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:32.742955 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3af38d00-64c6-427e-8a00-a637412f2753 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:32.748823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3af38d00-64c6-427e-8a00-a637412f2753 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:32.885648 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-3af38d00-64c6-427e-8a00-a637412f2753 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:32.887612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-dc21b4f9-8c53-4147-9fcd-e0e8e3d813b0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626225 Aug 26 15:58:32.888348 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 148/278] 10.222.0.94 () {60 vars in 1147 bytes} [Fri Aug 26 15:58:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 15:58:32.896137 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-3af38d00-64c6-427e-8a00-a637412f2753 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818" status: 200 len: 1318 microversion: 2.1 time: 0.167823 Aug 26 15:58:32.896268 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-8a9ed24c-f98b-4de3-91b9-9b97af1f909c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:32.897298 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-8a9ed24c-f98b-4de3-91b9-9b97af1f909c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:32.898687 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 131/279] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:32 2022] GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:32.906196 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-5fff4eeb-76e9-44a9-99f5-355a488e53aa tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:32.906804 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-5fff4eeb-76e9-44a9-99f5-355a488e53aa tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 33640225-7b6b-41b9-af71-b8698d9b9764] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:32.916751 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8a9ed24c-f98b-4de3-91b9-9b97af1f909c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:32.917878 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8a9ed24c-f98b-4de3-91b9-9b97af1f909c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:32.918499 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8a9ed24c-f98b-4de3-91b9-9b97af1f909c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:32.919316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8a9ed24c-f98b-4de3-91b9-9b97af1f909c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:32.919829 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8a9ed24c-f98b-4de3-91b9-9b97af1f909c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:32.920437 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8a9ed24c-f98b-4de3-91b9-9b97af1f909c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:32.969658 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-5fff4eeb-76e9-44a9-99f5-355a488e53aa tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:32.978965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-5fff4eeb-76e9-44a9-99f5-355a488e53aa tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764" status: 200 len: 1214 microversion: 2.1 time: 0.077160 Aug 26 15:58:32.980211 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 132/280] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:32 2022] GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:33.079917 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-8a9ed24c-f98b-4de3-91b9-9b97af1f909c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:33.092539 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-8a9ed24c-f98b-4de3-91b9-9b97af1f909c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.200370 Aug 26 15:58:33.093374 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 149/281] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:32 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:33.928807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-8e6c7e4b-6c73-4cd6-8e8f-2b080c004114 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:33.929488 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-8e6c7e4b-6c73-4cd6-8e8f-2b080c004114 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 98316258-36ac-4e26-b92d-48fc237b5818] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:33.931702 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell0:SELECT=2 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:33.938892 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8e6c7e4b-6c73-4cd6-8e8f-2b080c004114 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:33.939685 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8e6c7e4b-6c73-4cd6-8e8f-2b080c004114 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:33.940117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8e6c7e4b-6c73-4cd6-8e8f-2b080c004114 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:33.941638 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8e6c7e4b-6c73-4cd6-8e8f-2b080c004114 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:33.942166 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8e6c7e4b-6c73-4cd6-8e8f-2b080c004114 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:33.942890 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8e6c7e4b-6c73-4cd6-8e8f-2b080c004114 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:34.000206 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-c7139518-b0d5-4359-a887-1bcb06e0de27 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:34.000927 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-c7139518-b0d5-4359-a887-1bcb06e0de27 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 33640225-7b6b-41b9-af71-b8698d9b9764] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:34.002898 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:34.073438 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-c7139518-b0d5-4359-a887-1bcb06e0de27 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:34.080936 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-c7139518-b0d5-4359-a887-1bcb06e0de27 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764" status: 200 len: 1214 microversion: 2.1 time: 0.084630 Aug 26 15:58:34.081603 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 150/282] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:33 2022] GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:34.104294 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-8e6c7e4b-6c73-4cd6-8e8f-2b080c004114 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:34.116509 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-8e6c7e4b-6c73-4cd6-8e8f-2b080c004114 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818" status: 200 len: 1318 microversion: 2.1 time: 0.191989 Aug 26 15:58:34.121018 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 133/283] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:33 2022] GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:34.121585 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-1d8d4657-a37f-4bff-8591-0193599bb175 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:34.121585 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-1d8d4657-a37f-4bff-8591-0193599bb175 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:34.127994 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1d8d4657-a37f-4bff-8591-0193599bb175 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:34.128598 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1d8d4657-a37f-4bff-8591-0193599bb175 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:34.129029 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1d8d4657-a37f-4bff-8591-0193599bb175 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:34.130706 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1d8d4657-a37f-4bff-8591-0193599bb175 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:34.131419 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1d8d4657-a37f-4bff-8591-0193599bb175 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:34.132211 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1d8d4657-a37f-4bff-8591-0193599bb175 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:34.274347 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-1d8d4657-a37f-4bff-8591-0193599bb175 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:34.285188 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-1d8d4657-a37f-4bff-8591-0193599bb175 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.174231 Aug 26 15:58:34.285766 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 151/284] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:34 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:35.102400 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7f59bf8f-5210-4b76-9ae6-f79ada0d2fa0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:35.103071 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-7f59bf8f-5210-4b76-9ae6-f79ada0d2fa0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 33640225-7b6b-41b9-af71-b8698d9b9764] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:35.110577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7f59bf8f-5210-4b76-9ae6-f79ada0d2fa0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:35.111218 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7f59bf8f-5210-4b76-9ae6-f79ada0d2fa0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:35.111659 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7f59bf8f-5210-4b76-9ae6-f79ada0d2fa0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:35.112346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7f59bf8f-5210-4b76-9ae6-f79ada0d2fa0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:35.112804 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7f59bf8f-5210-4b76-9ae6-f79ada0d2fa0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:35.113601 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7f59bf8f-5210-4b76-9ae6-f79ada0d2fa0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:35.140439 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-73532c96-a8b4-46af-8914-d4b8669c0388 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:35.140996 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-73532c96-a8b4-46af-8914-d4b8669c0388 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 98316258-36ac-4e26-b92d-48fc237b5818] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:35.147442 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-73532c96-a8b4-46af-8914-d4b8669c0388 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:35.147921 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-73532c96-a8b4-46af-8914-d4b8669c0388 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:35.148352 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-73532c96-a8b4-46af-8914-d4b8669c0388 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:35.149043 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-73532c96-a8b4-46af-8914-d4b8669c0388 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:35.149492 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-73532c96-a8b4-46af-8914-d4b8669c0388 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:35.149916 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-73532c96-a8b4-46af-8914-d4b8669c0388 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:35.182947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7f59bf8f-5210-4b76-9ae6-f79ada0d2fa0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:35.194322 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-7f59bf8f-5210-4b76-9ae6-f79ada0d2fa0 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764" status: 200 len: 1266 microversion: 2.1 time: 0.095757 Aug 26 15:58:35.196094 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 134/285] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:35 2022] GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:35.297136 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-73532c96-a8b4-46af-8914-d4b8669c0388 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:35.306484 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-73532c96-a8b4-46af-8914-d4b8669c0388 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818" status: 200 len: 1318 microversion: 2.1 time: 0.170421 Aug 26 15:58:35.307159 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-03faaac7-a952-4d6f-be13-be839e4c421a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:35.307455 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 152/286] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:35 2022] GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:35.309077 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-03faaac7-a952-4d6f-be13-be839e4c421a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:35.315153 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-03faaac7-a952-4d6f-be13-be839e4c421a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:35.315701 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-03faaac7-a952-4d6f-be13-be839e4c421a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:35.316147 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-03faaac7-a952-4d6f-be13-be839e4c421a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:35.316852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-03faaac7-a952-4d6f-be13-be839e4c421a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:35.317312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-03faaac7-a952-4d6f-be13-be839e4c421a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:35.317742 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-03faaac7-a952-4d6f-be13-be839e4c421a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:35.489871 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-03faaac7-a952-4d6f-be13-be839e4c421a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:35.499797 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-03faaac7-a952-4d6f-be13-be839e4c421a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.196835 Aug 26 15:58:35.500408 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 135/287] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:35 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:36.218996 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-6b65abaf-863c-422a-885d-dbd8bb641333 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:36.220390 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-6b65abaf-863c-422a-885d-dbd8bb641333 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 33640225-7b6b-41b9-af71-b8698d9b9764] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:36.231196 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6b65abaf-863c-422a-885d-dbd8bb641333 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:36.231876 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6b65abaf-863c-422a-885d-dbd8bb641333 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:36.232529 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6b65abaf-863c-422a-885d-dbd8bb641333 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:36.233393 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6b65abaf-863c-422a-885d-dbd8bb641333 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:36.234110 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6b65abaf-863c-422a-885d-dbd8bb641333 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:36.234542 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6b65abaf-863c-422a-885d-dbd8bb641333 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:36.333657 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-55dc96bb-cbe8-4c8b-ad8d-3010b2036998 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:36.334508 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-55dc96bb-cbe8-4c8b-ad8d-3010b2036998 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 98316258-36ac-4e26-b92d-48fc237b5818] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:36.344224 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-6b65abaf-863c-422a-885d-dbd8bb641333 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:36.344454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-55dc96bb-cbe8-4c8b-ad8d-3010b2036998 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:36.344777 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-55dc96bb-cbe8-4c8b-ad8d-3010b2036998 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:36.345544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-55dc96bb-cbe8-4c8b-ad8d-3010b2036998 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:36.346258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-55dc96bb-cbe8-4c8b-ad8d-3010b2036998 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:36.346714 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-55dc96bb-cbe8-4c8b-ad8d-3010b2036998 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:36.347336 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-55dc96bb-cbe8-4c8b-ad8d-3010b2036998 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:36.355820 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-6b65abaf-863c-422a-885d-dbd8bb641333 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764" status: 200 len: 1266 microversion: 2.1 time: 0.141888 Aug 26 15:58:36.364284 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 153/288] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:36 2022] GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:36.498390 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-55dc96bb-cbe8-4c8b-ad8d-3010b2036998 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:36.506803 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-55dc96bb-cbe8-4c8b-ad8d-3010b2036998 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818" status: 200 len: 1318 microversion: 2.1 time: 0.179919 Aug 26 15:58:36.507537 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 136/289] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:36 2022] GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:36.524594 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-8d10b073-865d-4cbd-a6e3-d073a91abf96 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:36.527525 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-8d10b073-865d-4cbd-a6e3-d073a91abf96 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:36.533054 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8d10b073-865d-4cbd-a6e3-d073a91abf96 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:36.533536 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8d10b073-865d-4cbd-a6e3-d073a91abf96 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:36.533972 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8d10b073-865d-4cbd-a6e3-d073a91abf96 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:36.534670 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8d10b073-865d-4cbd-a6e3-d073a91abf96 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:36.535302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8d10b073-865d-4cbd-a6e3-d073a91abf96 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:36.535729 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8d10b073-865d-4cbd-a6e3-d073a91abf96 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:36.685640 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-8d10b073-865d-4cbd-a6e3-d073a91abf96 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:36.693441 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-8d10b073-865d-4cbd-a6e3-d073a91abf96 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.173069 Aug 26 15:58:36.694203 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 154/290] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:36 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:37.378959 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-c5dae554-58f2-46fc-9e3e-61a32374c607 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:37.379594 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-c5dae554-58f2-46fc-9e3e-61a32374c607 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 33640225-7b6b-41b9-af71-b8698d9b9764] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:37.397997 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c5dae554-58f2-46fc-9e3e-61a32374c607 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:37.398816 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c5dae554-58f2-46fc-9e3e-61a32374c607 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:37.399296 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c5dae554-58f2-46fc-9e3e-61a32374c607 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:37.400029 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c5dae554-58f2-46fc-9e3e-61a32374c607 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:37.400490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c5dae554-58f2-46fc-9e3e-61a32374c607 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:37.400922 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c5dae554-58f2-46fc-9e3e-61a32374c607 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:37.530971 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-d343bcd1-7e4d-4000-95c2-119ad9e0d35a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:37.532651 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-d343bcd1-7e4d-4000-95c2-119ad9e0d35a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 98316258-36ac-4e26-b92d-48fc237b5818] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:37.540129 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d343bcd1-7e4d-4000-95c2-119ad9e0d35a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:37.541333 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d343bcd1-7e4d-4000-95c2-119ad9e0d35a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:37.542018 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d343bcd1-7e4d-4000-95c2-119ad9e0d35a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:37.543684 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d343bcd1-7e4d-4000-95c2-119ad9e0d35a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:37.544348 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d343bcd1-7e4d-4000-95c2-119ad9e0d35a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:37.544926 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d343bcd1-7e4d-4000-95c2-119ad9e0d35a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:37.555914 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-c5dae554-58f2-46fc-9e3e-61a32374c607 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:37.567693 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-c5dae554-58f2-46fc-9e3e-61a32374c607 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764" status: 200 len: 1314 microversion: 2.1 time: 0.192749 Aug 26 15:58:37.568344 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 137/291] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:37 2022] GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:37.706118 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d343bcd1-7e4d-4000-95c2-119ad9e0d35a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:37.716145 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-1ad8da0e-e251-4ac6-a816-e11df211135b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:37.716852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-1ad8da0e-e251-4ac6-a816-e11df211135b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:37.718963 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-d343bcd1-7e4d-4000-95c2-119ad9e0d35a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818" status: 200 len: 1318 microversion: 2.1 time: 0.191580 Aug 26 15:58:37.728651 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1ad8da0e-e251-4ac6-a816-e11df211135b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:37.729146 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1ad8da0e-e251-4ac6-a816-e11df211135b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:37.729649 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1ad8da0e-e251-4ac6-a816-e11df211135b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:37.731572 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 155/292] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:37 2022] GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818 => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:37.734594 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1ad8da0e-e251-4ac6-a816-e11df211135b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:37.735459 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1ad8da0e-e251-4ac6-a816-e11df211135b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:37.735914 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1ad8da0e-e251-4ac6-a816-e11df211135b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:37.818141 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-523395f2-fd0c-4710-8096-1be956b5c3cd req-7b9fb9e1-d781-4483-b43a-42e93a85e873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98316258-36ac-4e26-b92d-48fc237b5818", "name": "network-vif-plugged", "status": "completed", "tag": "e7d4227b-1c33-41ac-a99b-20b0fcfca9cc"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:58:37.828277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-523395f2-fd0c-4710-8096-1be956b5c3cd req-7b9fb9e1-d781-4483-b43a-42e93a85e873 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:37.828744 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-523395f2-fd0c-4710-8096-1be956b5c3cd req-7b9fb9e1-d781-4483-b43a-42e93a85e873 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:37.829163 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-523395f2-fd0c-4710-8096-1be956b5c3cd req-7b9fb9e1-d781-4483-b43a-42e93a85e873 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:37.841040 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-523395f2-fd0c-4710-8096-1be956b5c3cd req-7b9fb9e1-d781-4483-b43a-42e93a85e873 service nova] Creating event network-vif-plugged:e7d4227b-1c33-41ac-a99b-20b0fcfca9cc for instance 98316258-36ac-4e26-b92d-48fc237b5818 on hv-cinder-85144 Aug 26 15:58:37.846316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-523395f2-fd0c-4710-8096-1be956b5c3cd req-7b9fb9e1-d781-4483-b43a-42e93a85e873 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031921 Aug 26 15:58:37.847060 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 156/293] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 15:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:58:37.891862 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-1ad8da0e-e251-4ac6-a816-e11df211135b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:37.894270 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=100 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:37.900433 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-1ad8da0e-e251-4ac6-a816-e11df211135b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.189367 Aug 26 15:58:37.901068 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 138/294] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:37 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:38.420409 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-b71997e2-b0ee-4194-8223-032adf9167f3 req-4e87bfcf-b942-4ab3-aad3-39f976507646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33640225-7b6b-41b9-af71-b8698d9b9764", "tag": "f4fa6357-1cb6-4a4e-8f53-16e01e325ce4"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:58:38.430189 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-b71997e2-b0ee-4194-8223-032adf9167f3 req-4e87bfcf-b942-4ab3-aad3-39f976507646 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:38.430653 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-b71997e2-b0ee-4194-8223-032adf9167f3 req-4e87bfcf-b942-4ab3-aad3-39f976507646 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:38.431345 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-b71997e2-b0ee-4194-8223-032adf9167f3 req-4e87bfcf-b942-4ab3-aad3-39f976507646 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:38.444230 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-b71997e2-b0ee-4194-8223-032adf9167f3 req-4e87bfcf-b942-4ab3-aad3-39f976507646 service nova] Creating event network-changed:f4fa6357-1cb6-4a4e-8f53-16e01e325ce4 for instance 33640225-7b6b-41b9-af71-b8698d9b9764 on hv-cinder-85144 Aug 26 15:58:38.449766 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-b71997e2-b0ee-4194-8223-032adf9167f3 req-4e87bfcf-b942-4ab3-aad3-39f976507646 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033627 Aug 26 15:58:38.450470 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 157/295] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 15:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:58:38.599339 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-e25161e2-651d-4bd6-a75b-37235672c870 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:38.599955 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-e25161e2-651d-4bd6-a75b-37235672c870 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 33640225-7b6b-41b9-af71-b8698d9b9764] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:38.606597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e25161e2-651d-4bd6-a75b-37235672c870 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:38.607130 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e25161e2-651d-4bd6-a75b-37235672c870 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:38.607561 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e25161e2-651d-4bd6-a75b-37235672c870 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:38.608261 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e25161e2-651d-4bd6-a75b-37235672c870 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:38.608742 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e25161e2-651d-4bd6-a75b-37235672c870 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:38.609128 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e25161e2-651d-4bd6-a75b-37235672c870 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:38.740911 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e25161e2-651d-4bd6-a75b-37235672c870 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:38.744762 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-b18ca3da-8bb2-4bae-a79a-f625152f45b9 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:38.746770 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-b18ca3da-8bb2-4bae-a79a-f625152f45b9 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 98316258-36ac-4e26-b92d-48fc237b5818] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:38.750971 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-e25161e2-651d-4bd6-a75b-37235672c870 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764" status: 200 len: 1314 microversion: 2.1 time: 0.158387 Aug 26 15:58:38.751658 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 139/296] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:38 2022] GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:38.753775 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b18ca3da-8bb2-4bae-a79a-f625152f45b9 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:38.754260 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b18ca3da-8bb2-4bae-a79a-f625152f45b9 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:38.754688 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b18ca3da-8bb2-4bae-a79a-f625152f45b9 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:38.755470 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b18ca3da-8bb2-4bae-a79a-f625152f45b9 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:38.755923 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b18ca3da-8bb2-4bae-a79a-f625152f45b9 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:38.756352 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b18ca3da-8bb2-4bae-a79a-f625152f45b9 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:38.897961 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b18ca3da-8bb2-4bae-a79a-f625152f45b9 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:38.906227 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-b18ca3da-8bb2-4bae-a79a-f625152f45b9 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818" status: 200 len: 1318 microversion: 2.1 time: 0.165416 Aug 26 15:58:38.906987 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 158/297] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:38 2022] GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:38.922069 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-4bda9494-8965-474c-8e65-f858b7acff15 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:38.922715 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-4bda9494-8965-474c-8e65-f858b7acff15 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:38.929139 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4bda9494-8965-474c-8e65-f858b7acff15 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:38.929738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4bda9494-8965-474c-8e65-f858b7acff15 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:38.930246 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4bda9494-8965-474c-8e65-f858b7acff15 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:38.931181 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4bda9494-8965-474c-8e65-f858b7acff15 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:38.931810 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4bda9494-8965-474c-8e65-f858b7acff15 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:38.932248 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4bda9494-8965-474c-8e65-f858b7acff15 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:39.068476 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-4bda9494-8965-474c-8e65-f858b7acff15 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:39.077086 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-4bda9494-8965-474c-8e65-f858b7acff15 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.158849 Aug 26 15:58:39.077650 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 140/298] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:38 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:39.772713 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-6c0b9c46-a975-400c-8c3a-8cd91ce1bac2 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:39.773237 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-6c0b9c46-a975-400c-8c3a-8cd91ce1bac2 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 33640225-7b6b-41b9-af71-b8698d9b9764] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:39.779325 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6c0b9c46-a975-400c-8c3a-8cd91ce1bac2 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:39.779890 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6c0b9c46-a975-400c-8c3a-8cd91ce1bac2 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:39.784422 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6c0b9c46-a975-400c-8c3a-8cd91ce1bac2 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:39.785114 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6c0b9c46-a975-400c-8c3a-8cd91ce1bac2 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:39.785566 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6c0b9c46-a975-400c-8c3a-8cd91ce1bac2 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:39.785984 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6c0b9c46-a975-400c-8c3a-8cd91ce1bac2 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:39.927574 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-fd1a8076-d034-4b2d-8e5a-eda9cc878897 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:39.928225 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-fd1a8076-d034-4b2d-8e5a-eda9cc878897 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 98316258-36ac-4e26-b92d-48fc237b5818] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:39.933985 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-6c0b9c46-a975-400c-8c3a-8cd91ce1bac2 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:39.935985 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fd1a8076-d034-4b2d-8e5a-eda9cc878897 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:39.936645 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fd1a8076-d034-4b2d-8e5a-eda9cc878897 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:39.937089 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fd1a8076-d034-4b2d-8e5a-eda9cc878897 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:39.938154 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fd1a8076-d034-4b2d-8e5a-eda9cc878897 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:39.938266 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fd1a8076-d034-4b2d-8e5a-eda9cc878897 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:39.938778 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fd1a8076-d034-4b2d-8e5a-eda9cc878897 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:39.942690 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-6c0b9c46-a975-400c-8c3a-8cd91ce1bac2 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764" status: 200 len: 1314 microversion: 2.1 time: 0.173915 Aug 26 15:58:39.943362 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 159/299] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:39 2022] GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:40.077386 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-fd1a8076-d034-4b2d-8e5a-eda9cc878897 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:40.086128 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-fd1a8076-d034-4b2d-8e5a-eda9cc878897 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818" status: 200 len: 1318 microversion: 2.1 time: 0.162380 Aug 26 15:58:40.087117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 141/300] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:39 2022] GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:40.097714 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-fdf05dd3-b83f-434d-b41b-b64c6b1b894a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:40.098554 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-fdf05dd3-b83f-434d-b41b-b64c6b1b894a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:40.116813 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fdf05dd3-b83f-434d-b41b-b64c6b1b894a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:40.117310 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fdf05dd3-b83f-434d-b41b-b64c6b1b894a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:40.117753 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fdf05dd3-b83f-434d-b41b-b64c6b1b894a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:40.118455 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fdf05dd3-b83f-434d-b41b-b64c6b1b894a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:40.118905 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fdf05dd3-b83f-434d-b41b-b64c6b1b894a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:40.119352 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fdf05dd3-b83f-434d-b41b-b64c6b1b894a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:40.218201 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-5d4b0b50-9b81-448a-a0f2-d4f221f79de4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:40.219094 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-5d4b0b50-9b81-448a-a0f2-d4f221f79de4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:40.227613 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d4b0b50-9b81-448a-a0f2-d4f221f79de4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:40.228443 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d4b0b50-9b81-448a-a0f2-d4f221f79de4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:40.229122 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d4b0b50-9b81-448a-a0f2-d4f221f79de4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:40.231452 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d4b0b50-9b81-448a-a0f2-d4f221f79de4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:40.234823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d4b0b50-9b81-448a-a0f2-d4f221f79de4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:40.240298 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d4b0b50-9b81-448a-a0f2-d4f221f79de4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:40.269034 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-5d4b0b50-9b81-448a-a0f2-d4f221f79de4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e/ips" status: 200 len: 146 microversion: 2.1 time: 0.058125 Aug 26 15:58:40.269861 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 142/301] 10.222.0.94 () {58 vars in 1248 bytes} [Fri Aug 26 15:58:40 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e/ips => generated 146 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:58:40.281759 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-fdf05dd3-b83f-434d-b41b-b64c6b1b894a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:40.289690 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-fdf05dd3-b83f-434d-b41b-b64c6b1b894a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.195720 Aug 26 15:58:40.290908 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 160/302] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:40 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:40.964672 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-47aa5147-ccce-4c6c-8952-79d8a4b98d5a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:40.965202 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-47aa5147-ccce-4c6c-8952-79d8a4b98d5a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 33640225-7b6b-41b9-af71-b8698d9b9764] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:40.971200 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-47aa5147-ccce-4c6c-8952-79d8a4b98d5a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:40.971681 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-47aa5147-ccce-4c6c-8952-79d8a4b98d5a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:40.972121 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-47aa5147-ccce-4c6c-8952-79d8a4b98d5a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:40.972800 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-47aa5147-ccce-4c6c-8952-79d8a4b98d5a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:40.973248 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-47aa5147-ccce-4c6c-8952-79d8a4b98d5a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:40.973673 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-47aa5147-ccce-4c6c-8952-79d8a4b98d5a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:41.109379 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-7b35077a-1c3f-4fa8-a999-e5275b666ec4 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:41.110016 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-7b35077a-1c3f-4fa8-a999-e5275b666ec4 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 98316258-36ac-4e26-b92d-48fc237b5818] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:41.110440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-47aa5147-ccce-4c6c-8952-79d8a4b98d5a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:41.116131 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7b35077a-1c3f-4fa8-a999-e5275b666ec4 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:41.116815 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7b35077a-1c3f-4fa8-a999-e5275b666ec4 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:41.117403 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7b35077a-1c3f-4fa8-a999-e5275b666ec4 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:41.118058 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-47aa5147-ccce-4c6c-8952-79d8a4b98d5a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764" status: 200 len: 1314 microversion: 2.1 time: 0.158062 Aug 26 15:58:41.118178 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7b35077a-1c3f-4fa8-a999-e5275b666ec4 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:41.118595 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7b35077a-1c3f-4fa8-a999-e5275b666ec4 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:41.118730 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 143/303] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:40 2022] GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:41.119325 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7b35077a-1c3f-4fa8-a999-e5275b666ec4 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:41.124724 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=100 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:41.279787 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-7b35077a-1c3f-4fa8-a999-e5275b666ec4 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:41.287311 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-7b35077a-1c3f-4fa8-a999-e5275b666ec4 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818" status: 200 len: 1506 microversion: 2.1 time: 0.183362 Aug 26 15:58:41.287864 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 161/304] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:41 2022] GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818 => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:41.320146 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-3cbf2636-22f3-446f-bd75-40379da45992 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:41.320735 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-3cbf2636-22f3-446f-bd75-40379da45992 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:41.332563 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3cbf2636-22f3-446f-bd75-40379da45992 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:41.341612 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3cbf2636-22f3-446f-bd75-40379da45992 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:41.341612 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3cbf2636-22f3-446f-bd75-40379da45992 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:41.341612 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3cbf2636-22f3-446f-bd75-40379da45992 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:41.341612 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3cbf2636-22f3-446f-bd75-40379da45992 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:41.342227 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3cbf2636-22f3-446f-bd75-40379da45992 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:41.499462 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-3cbf2636-22f3-446f-bd75-40379da45992 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:41.509153 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-3cbf2636-22f3-446f-bd75-40379da45992 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.193013 Aug 26 15:58:41.510035 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 144/305] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:41 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:41.871377 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-b8192d67-f830-40b1-90c7-32079a1cf6e5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:41.871864 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-b8192d67-f830-40b1-90c7-32079a1cf6e5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:41.881628 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b8192d67-f830-40b1-90c7-32079a1cf6e5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:41.881628 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b8192d67-f830-40b1-90c7-32079a1cf6e5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:41.881628 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b8192d67-f830-40b1-90c7-32079a1cf6e5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:41.881628 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b8192d67-f830-40b1-90c7-32079a1cf6e5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:41.882343 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b8192d67-f830-40b1-90c7-32079a1cf6e5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:41.882343 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b8192d67-f830-40b1-90c7-32079a1cf6e5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:41.905213 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-b8192d67-f830-40b1-90c7-32079a1cf6e5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a/ips" status: 200 len: 149 microversion: 2.1 time: 0.038743 Aug 26 15:58:41.905784 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 162/306] 10.222.0.94 () {58 vars in 1248 bytes} [Fri Aug 26 15:58:41 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:58:42.082616 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-a25bc916-7ab3-4604-b508-a712971ed6df tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:42.083289 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-a25bc916-7ab3-4604-b508-a712971ed6df tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:42.090310 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a25bc916-7ab3-4604-b508-a712971ed6df tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:42.090800 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a25bc916-7ab3-4604-b508-a712971ed6df tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:42.091270 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a25bc916-7ab3-4604-b508-a712971ed6df tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:42.091999 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a25bc916-7ab3-4604-b508-a712971ed6df tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:42.106567 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a25bc916-7ab3-4604-b508-a712971ed6df tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:42.106567 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a25bc916-7ab3-4604-b508-a712971ed6df tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:42.116605 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-a25bc916-7ab3-4604-b508-a712971ed6df tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1/ips" status: 200 len: 152 microversion: 2.20 time: 0.038611 Aug 26 15:58:42.117169 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 145/307] 10.222.0.94 () {60 vars in 1289 bytes} [Fri Aug 26 15:58:42 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 15:58:42.145140 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-9967a170-63b4-4524-8aa0-5425d324eac3 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:42.145772 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-9967a170-63b4-4524-8aa0-5425d324eac3 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 33640225-7b6b-41b9-af71-b8698d9b9764] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:42.152163 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9967a170-63b4-4524-8aa0-5425d324eac3 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:42.152665 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9967a170-63b4-4524-8aa0-5425d324eac3 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:42.153130 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9967a170-63b4-4524-8aa0-5425d324eac3 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:42.153809 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9967a170-63b4-4524-8aa0-5425d324eac3 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:42.154353 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9967a170-63b4-4524-8aa0-5425d324eac3 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:42.154784 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9967a170-63b4-4524-8aa0-5425d324eac3 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:42.299431 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-9967a170-63b4-4524-8aa0-5425d324eac3 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:42.306938 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-9967a170-63b4-4524-8aa0-5425d324eac3 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764" status: 200 len: 1314 microversion: 2.1 time: 0.165600 Aug 26 15:58:42.307623 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 163/308] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:42 2022] GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:42.533205 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7dcc2fec-909d-465e-bd14-3f885d81c6a0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:42.533816 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-7dcc2fec-909d-465e-bd14-3f885d81c6a0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:42.539863 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7dcc2fec-909d-465e-bd14-3f885d81c6a0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:42.540346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7dcc2fec-909d-465e-bd14-3f885d81c6a0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:42.540783 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7dcc2fec-909d-465e-bd14-3f885d81c6a0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:42.541469 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7dcc2fec-909d-465e-bd14-3f885d81c6a0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:42.542505 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7dcc2fec-909d-465e-bd14-3f885d81c6a0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:42.542954 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7dcc2fec-909d-465e-bd14-3f885d81c6a0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:42.684536 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7dcc2fec-909d-465e-bd14-3f885d81c6a0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:42.692433 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-7dcc2fec-909d-465e-bd14-3f885d81c6a0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.163486 Aug 26 15:58:42.692996 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 146/309] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:42 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:43.329134 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-63ce258e-6af8-4a67-b504-d966e605ac62 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:43.330500 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-63ce258e-6af8-4a67-b504-d966e605ac62 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 33640225-7b6b-41b9-af71-b8698d9b9764] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:43.332428 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell0:SELECT=2 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:43.342498 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63ce258e-6af8-4a67-b504-d966e605ac62 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:43.342498 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63ce258e-6af8-4a67-b504-d966e605ac62 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:43.342498 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63ce258e-6af8-4a67-b504-d966e605ac62 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:43.342498 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63ce258e-6af8-4a67-b504-d966e605ac62 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:43.342854 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63ce258e-6af8-4a67-b504-d966e605ac62 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:43.342854 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63ce258e-6af8-4a67-b504-d966e605ac62 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:43.490074 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-63ce258e-6af8-4a67-b504-d966e605ac62 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:43.499031 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-63ce258e-6af8-4a67-b504-d966e605ac62 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764" status: 200 len: 1314 microversion: 2.1 time: 0.173640 Aug 26 15:58:43.499377 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 164/310] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:43 2022] GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:43.715668 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-687f3ae3-4bc1-4a5d-8920-71a70d1d2c0e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:43.716276 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-687f3ae3-4bc1-4a5d-8920-71a70d1d2c0e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:43.719398 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell0:SELECT=8 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:43.724556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-687f3ae3-4bc1-4a5d-8920-71a70d1d2c0e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:43.725034 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-687f3ae3-4bc1-4a5d-8920-71a70d1d2c0e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:43.725465 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-687f3ae3-4bc1-4a5d-8920-71a70d1d2c0e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:43.726303 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-687f3ae3-4bc1-4a5d-8920-71a70d1d2c0e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:43.726751 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-687f3ae3-4bc1-4a5d-8920-71a70d1d2c0e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:43.727205 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-687f3ae3-4bc1-4a5d-8920-71a70d1d2c0e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:43.901491 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-687f3ae3-4bc1-4a5d-8920-71a70d1d2c0e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:43.909458 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-687f3ae3-4bc1-4a5d-8920-71a70d1d2c0e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.198217 Aug 26 15:58:43.910022 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 147/311] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:43 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:44.367420 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-698d5f36-c8b7-45c9-a29a-e3419923f4a6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc38ae63-0f90-4fe5-a819-35260b1179fe"}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:58:44.369828 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-698d5f36-c8b7-45c9-a29a-e3419923f4a6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:44.372051 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell0:SELECT=12 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:44.376892 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-698d5f36-c8b7-45c9-a29a-e3419923f4a6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:44.377379 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-698d5f36-c8b7-45c9-a29a-e3419923f4a6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:44.377843 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-698d5f36-c8b7-45c9-a29a-e3419923f4a6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:44.378724 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-698d5f36-c8b7-45c9-a29a-e3419923f4a6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:44.379353 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-698d5f36-c8b7-45c9-a29a-e3419923f4a6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:44.379941 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-698d5f36-c8b7-45c9-a29a-e3419923f4a6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:44.520828 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-9a0e92a1-a8ca-4a6a-88cc-8f807ab6ed07 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:44.521570 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-9a0e92a1-a8ca-4a6a-88cc-8f807ab6ed07 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 33640225-7b6b-41b9-af71-b8698d9b9764] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:44.528657 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9a0e92a1-a8ca-4a6a-88cc-8f807ab6ed07 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:44.529142 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9a0e92a1-a8ca-4a6a-88cc-8f807ab6ed07 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:44.529573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9a0e92a1-a8ca-4a6a-88cc-8f807ab6ed07 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:44.530267 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9a0e92a1-a8ca-4a6a-88cc-8f807ab6ed07 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:44.530718 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9a0e92a1-a8ca-4a6a-88cc-8f807ab6ed07 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:44.531175 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9a0e92a1-a8ca-4a6a-88cc-8f807ab6ed07 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:44.691659 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-9a0e92a1-a8ca-4a6a-88cc-8f807ab6ed07 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:44.699962 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-9a0e92a1-a8ca-4a6a-88cc-8f807ab6ed07 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764" status: 200 len: 1314 microversion: 2.1 time: 0.183011 Aug 26 15:58:44.700560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 148/312] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:44 2022] GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:44.938229 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-e7efe72e-54af-4265-b1a2-1603b8c668ea tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:44.939500 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-e7efe72e-54af-4265-b1a2-1603b8c668ea tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:44.957295 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e7efe72e-54af-4265-b1a2-1603b8c668ea tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:44.957295 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e7efe72e-54af-4265-b1a2-1603b8c668ea tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:44.957295 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e7efe72e-54af-4265-b1a2-1603b8c668ea tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:44.957295 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e7efe72e-54af-4265-b1a2-1603b8c668ea tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:44.957746 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e7efe72e-54af-4265-b1a2-1603b8c668ea tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:44.958152 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e7efe72e-54af-4265-b1a2-1603b8c668ea tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:45.184956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e7efe72e-54af-4265-b1a2-1603b8c668ea tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:45.193453 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-e7efe72e-54af-4265-b1a2-1603b8c668ea tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.261910 Aug 26 15:58:45.193453 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 149/313] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:44 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:45.455572 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-698d5f36-c8b7-45c9-a29a-e3419923f4a6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "POST /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.091567 Aug 26 15:58:45.456566 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 165/314] 10.222.0.94 () {60 vars in 1323 bytes} [Fri Aug 26 15:58:44 2022] POST /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a/os-volume_attachments => generated 194 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:58:45.721723 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-c22ea894-4274-4520-9153-e4364c2f2a66 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:45.722336 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-c22ea894-4274-4520-9153-e4364c2f2a66 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 33640225-7b6b-41b9-af71-b8698d9b9764] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:45.737992 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c22ea894-4274-4520-9153-e4364c2f2a66 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:45.738689 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c22ea894-4274-4520-9153-e4364c2f2a66 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:45.739883 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c22ea894-4274-4520-9153-e4364c2f2a66 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:45.740783 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c22ea894-4274-4520-9153-e4364c2f2a66 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:45.741583 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c22ea894-4274-4520-9153-e4364c2f2a66 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:45.741853 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c22ea894-4274-4520-9153-e4364c2f2a66 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:45.839542 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-1c82d4f2-c81a-4a13-9acf-1a52978dc730 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b0a7e6d-4c5e-44be-aaad-135a83e98872"}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:58:45.842042 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-1c82d4f2-c81a-4a13-9acf-1a52978dc730 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:45.848652 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1c82d4f2-c81a-4a13-9acf-1a52978dc730 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:45.853760 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1c82d4f2-c81a-4a13-9acf-1a52978dc730 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:45.853760 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1c82d4f2-c81a-4a13-9acf-1a52978dc730 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:45.853760 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1c82d4f2-c81a-4a13-9acf-1a52978dc730 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:45.853760 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1c82d4f2-c81a-4a13-9acf-1a52978dc730 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:45.854079 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1c82d4f2-c81a-4a13-9acf-1a52978dc730 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:45.879920 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-c22ea894-4274-4520-9153-e4364c2f2a66 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:45.887857 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-c22ea894-4274-4520-9153-e4364c2f2a66 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764" status: 200 len: 1314 microversion: 2.1 time: 0.169995 Aug 26 15:58:45.888426 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 150/315] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:45 2022] GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:46.217085 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-0f526992-7d9f-4f8a-83a5-43821e66e514 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:46.218323 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-0f526992-7d9f-4f8a-83a5-43821e66e514 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:46.227047 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f526992-7d9f-4f8a-83a5-43821e66e514 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:46.227573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f526992-7d9f-4f8a-83a5-43821e66e514 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:46.228028 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f526992-7d9f-4f8a-83a5-43821e66e514 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:46.228842 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f526992-7d9f-4f8a-83a5-43821e66e514 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:46.230095 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f526992-7d9f-4f8a-83a5-43821e66e514 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:46.230530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f526992-7d9f-4f8a-83a5-43821e66e514 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:46.377744 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-0f526992-7d9f-4f8a-83a5-43821e66e514 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:46.387585 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-0f526992-7d9f-4f8a-83a5-43821e66e514 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.177454 Aug 26 15:58:46.388175 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 151/316] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:46 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:46.869014 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-1c82d4f2-c81a-4a13-9acf-1a52978dc730 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "POST /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.034071 Aug 26 15:58:46.871850 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 166/317] 10.222.0.94 () {60 vars in 1323 bytes} [Fri Aug 26 15:58:45 2022] POST /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e/os-volume_attachments => generated 194 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:58:46.909149 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-299f5905-4fbf-4312-810c-224922c3c9e3 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:46.909919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-299f5905-4fbf-4312-810c-224922c3c9e3 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 33640225-7b6b-41b9-af71-b8698d9b9764] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:46.917275 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-009adbb7-82cc-46f5-84e8-3d6e07ab7f17 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:58:46.921293 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-009adbb7-82cc-46f5-84e8-3d6e07ab7f17 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:46.931391 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-009adbb7-82cc-46f5-84e8-3d6e07ab7f17 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:46.931965 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-009adbb7-82cc-46f5-84e8-3d6e07ab7f17 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:46.933101 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-009adbb7-82cc-46f5-84e8-3d6e07ab7f17 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:46.933322 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-299f5905-4fbf-4312-810c-224922c3c9e3 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:46.933940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-009adbb7-82cc-46f5-84e8-3d6e07ab7f17 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:46.934135 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-299f5905-4fbf-4312-810c-224922c3c9e3 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:46.934459 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-009adbb7-82cc-46f5-84e8-3d6e07ab7f17 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:46.934570 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-299f5905-4fbf-4312-810c-224922c3c9e3 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:46.934873 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-009adbb7-82cc-46f5-84e8-3d6e07ab7f17 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:46.935311 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-299f5905-4fbf-4312-810c-224922c3c9e3 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:46.935770 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-299f5905-4fbf-4312-810c-224922c3c9e3 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:46.936279 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-299f5905-4fbf-4312-810c-224922c3c9e3 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:46.962439 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-009adbb7-82cc-46f5-84e8-3d6e07ab7f17 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lazy-loading 'flavor' on Instance uuid 8ac977a7-aa08-459a-a863-36ba667422d1 {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:58:47.106943 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-299f5905-4fbf-4312-810c-224922c3c9e3 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:47.116935 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-299f5905-4fbf-4312-810c-224922c3c9e3 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764" status: 200 len: 1314 microversion: 2.1 time: 0.212113 Aug 26 15:58:47.117728 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 152/318] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:46 2022] GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:47.418440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-3d0c449e-8025-4ea7-8456-77dbff306142 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:47.419844 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-3d0c449e-8025-4ea7-8456-77dbff306142 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:47.427365 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3d0c449e-8025-4ea7-8456-77dbff306142 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:47.427861 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3d0c449e-8025-4ea7-8456-77dbff306142 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:47.428311 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3d0c449e-8025-4ea7-8456-77dbff306142 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:47.429021 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3d0c449e-8025-4ea7-8456-77dbff306142 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:47.429532 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3d0c449e-8025-4ea7-8456-77dbff306142 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:47.429991 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3d0c449e-8025-4ea7-8456-77dbff306142 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:47.574680 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-3d0c449e-8025-4ea7-8456-77dbff306142 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:47.582973 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-3d0c449e-8025-4ea7-8456-77dbff306142 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.170594 Aug 26 15:58:47.583546 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 153/319] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:47 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:47.670653 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-ea510667-f875-4694-a65d-afda4ff2eee1 req-b836a80e-d679-4e6a-b326-22a8b29871f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33640225-7b6b-41b9-af71-b8698d9b9764", "name": "network-vif-plugged", "status": "completed", "tag": "f4fa6357-1cb6-4a4e-8f53-16e01e325ce4"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:58:47.682114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-ea510667-f875-4694-a65d-afda4ff2eee1 req-b836a80e-d679-4e6a-b326-22a8b29871f8 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:47.683328 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-ea510667-f875-4694-a65d-afda4ff2eee1 req-b836a80e-d679-4e6a-b326-22a8b29871f8 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:47.683915 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-ea510667-f875-4694-a65d-afda4ff2eee1 req-b836a80e-d679-4e6a-b326-22a8b29871f8 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:47.695635 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-ea510667-f875-4694-a65d-afda4ff2eee1 req-b836a80e-d679-4e6a-b326-22a8b29871f8 service nova] Creating event network-vif-plugged:f4fa6357-1cb6-4a4e-8f53-16e01e325ce4 for instance 33640225-7b6b-41b9-af71-b8698d9b9764 on hv-cinder-85144 Aug 26 15:58:47.702245 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-ea510667-f875-4694-a65d-afda4ff2eee1 req-b836a80e-d679-4e6a-b326-22a8b29871f8 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036253 Aug 26 15:58:47.703236 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 154/320] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 15:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:58:48.141370 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f01eda72-a8f0-4f90-ac22-5a74dcc0164d tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:48.142202 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-f01eda72-a8f0-4f90-ac22-5a74dcc0164d tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 33640225-7b6b-41b9-af71-b8698d9b9764] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:48.149481 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f01eda72-a8f0-4f90-ac22-5a74dcc0164d tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:48.150050 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f01eda72-a8f0-4f90-ac22-5a74dcc0164d tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:48.150675 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f01eda72-a8f0-4f90-ac22-5a74dcc0164d tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:48.152839 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f01eda72-a8f0-4f90-ac22-5a74dcc0164d tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:48.153379 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f01eda72-a8f0-4f90-ac22-5a74dcc0164d tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:48.154084 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f01eda72-a8f0-4f90-ac22-5a74dcc0164d tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:48.300820 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-f01eda72-a8f0-4f90-ac22-5a74dcc0164d tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:48.309799 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-f01eda72-a8f0-4f90-ac22-5a74dcc0164d tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764" status: 200 len: 1314 microversion: 2.1 time: 0.172688 Aug 26 15:58:48.310370 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 155/321] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:48 2022] GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:48.605400 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ef717a59-babf-4401-93e1-15795f61b12a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:48.606013 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ef717a59-babf-4401-93e1-15795f61b12a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:48.612421 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ef717a59-babf-4401-93e1-15795f61b12a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:48.614108 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ef717a59-babf-4401-93e1-15795f61b12a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:48.614108 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ef717a59-babf-4401-93e1-15795f61b12a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:48.614108 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ef717a59-babf-4401-93e1-15795f61b12a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:48.614425 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ef717a59-babf-4401-93e1-15795f61b12a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:48.614843 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ef717a59-babf-4401-93e1-15795f61b12a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:48.752508 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-ef717a59-babf-4401-93e1-15795f61b12a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:48.754726 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=100 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:48.761340 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ef717a59-babf-4401-93e1-15795f61b12a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.160068 Aug 26 15:58:48.761919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 156/322] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:48 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:49.330713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-182d28cd-4ac9-494d-be5e-dce95f2ee47d tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:49.331310 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-182d28cd-4ac9-494d-be5e-dce95f2ee47d tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 33640225-7b6b-41b9-af71-b8698d9b9764] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:49.337709 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-182d28cd-4ac9-494d-be5e-dce95f2ee47d tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:49.338180 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-182d28cd-4ac9-494d-be5e-dce95f2ee47d tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:49.339289 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-182d28cd-4ac9-494d-be5e-dce95f2ee47d tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:49.339994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-182d28cd-4ac9-494d-be5e-dce95f2ee47d tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:49.340437 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-182d28cd-4ac9-494d-be5e-dce95f2ee47d tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:49.340857 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-182d28cd-4ac9-494d-be5e-dce95f2ee47d tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:49.481624 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-182d28cd-4ac9-494d-be5e-dce95f2ee47d tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:49.489484 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-182d28cd-4ac9-494d-be5e-dce95f2ee47d tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764" status: 200 len: 1314 microversion: 2.1 time: 0.162611 Aug 26 15:58:49.490046 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 157/323] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:49 2022] GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:49.791596 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-06c2fcbc-be3b-463f-9ba2-e7831dd0bfeb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:49.792377 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-06c2fcbc-be3b-463f-9ba2-e7831dd0bfeb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:49.798754 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-06c2fcbc-be3b-463f-9ba2-e7831dd0bfeb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:49.799278 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-06c2fcbc-be3b-463f-9ba2-e7831dd0bfeb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:49.799718 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-06c2fcbc-be3b-463f-9ba2-e7831dd0bfeb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:49.800411 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-06c2fcbc-be3b-463f-9ba2-e7831dd0bfeb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:49.800867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-06c2fcbc-be3b-463f-9ba2-e7831dd0bfeb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:49.801296 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-06c2fcbc-be3b-463f-9ba2-e7831dd0bfeb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:49.938757 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-06c2fcbc-be3b-463f-9ba2-e7831dd0bfeb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:49.946583 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-06c2fcbc-be3b-463f-9ba2-e7831dd0bfeb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.158814 Aug 26 15:58:49.947204 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 158/324] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:49 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:50.511379 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-01c363f4-51ed-4df1-8f05-2b48bda0fd99 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:50.512091 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-01c363f4-51ed-4df1-8f05-2b48bda0fd99 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 33640225-7b6b-41b9-af71-b8698d9b9764] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:50.518170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-01c363f4-51ed-4df1-8f05-2b48bda0fd99 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:50.518654 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-01c363f4-51ed-4df1-8f05-2b48bda0fd99 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:50.519137 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-01c363f4-51ed-4df1-8f05-2b48bda0fd99 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:50.519848 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-01c363f4-51ed-4df1-8f05-2b48bda0fd99 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:50.520306 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-01c363f4-51ed-4df1-8f05-2b48bda0fd99 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:50.520733 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-01c363f4-51ed-4df1-8f05-2b48bda0fd99 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:50.639396 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-009adbb7-82cc-46f5-84e8-3d6e07ab7f17 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "POST /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1/action" status: 202 len: 0 microversion: 2.20 time: 3.726123 Aug 26 15:58:50.645338 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 167/325] 10.222.0.94 () {62 vars in 1319 bytes} [Fri Aug 26 15:58:46 2022] POST /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1/action => generated 0 bytes in 3728 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 26 15:58:50.655438 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-abbdfb1f-d788-47d4-a2e9-afcda57405f8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:50.656333 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-abbdfb1f-d788-47d4-a2e9-afcda57405f8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:50.665826 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-01c363f4-51ed-4df1-8f05-2b48bda0fd99 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:50.673580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-abbdfb1f-d788-47d4-a2e9-afcda57405f8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:50.674071 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-abbdfb1f-d788-47d4-a2e9-afcda57405f8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:50.674508 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-abbdfb1f-d788-47d4-a2e9-afcda57405f8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:50.674639 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-01c363f4-51ed-4df1-8f05-2b48bda0fd99 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764" status: 200 len: 1314 microversion: 2.1 time: 0.167975 Aug 26 15:58:50.675125 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 159/326] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:50 2022] GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:50.679003 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-abbdfb1f-d788-47d4-a2e9-afcda57405f8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:50.679003 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-abbdfb1f-d788-47d4-a2e9-afcda57405f8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:50.679003 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-abbdfb1f-d788-47d4-a2e9-afcda57405f8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:50.821631 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-abbdfb1f-d788-47d4-a2e9-afcda57405f8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:50.831636 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-abbdfb1f-d788-47d4-a2e9-afcda57405f8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:50.841784 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-abbdfb1f-d788-47d4-a2e9-afcda57405f8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:50.841784 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-abbdfb1f-d788-47d4-a2e9-afcda57405f8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.190114 Aug 26 15:58:50.841784 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 168/327] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:58:50 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:58:50.973555 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-8aa63a15-8b45-4f2b-8735-45f720d60707 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:50.974173 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-8aa63a15-8b45-4f2b-8735-45f720d60707 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:50.980964 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8aa63a15-8b45-4f2b-8735-45f720d60707 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:50.981582 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8aa63a15-8b45-4f2b-8735-45f720d60707 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:50.982157 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8aa63a15-8b45-4f2b-8735-45f720d60707 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:50.983076 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8aa63a15-8b45-4f2b-8735-45f720d60707 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:50.983541 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8aa63a15-8b45-4f2b-8735-45f720d60707 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:50.983968 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8aa63a15-8b45-4f2b-8735-45f720d60707 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:51.126984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-8aa63a15-8b45-4f2b-8735-45f720d60707 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:51.134633 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-8aa63a15-8b45-4f2b-8735-45f720d60707 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.164936 Aug 26 15:58:51.135216 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 160/328] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:50 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:51.695123 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-31314cf8-aec6-4abc-9020-210b19465aee tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:51.695655 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-31314cf8-aec6-4abc-9020-210b19465aee tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 33640225-7b6b-41b9-af71-b8698d9b9764] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:51.702830 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31314cf8-aec6-4abc-9020-210b19465aee tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:51.703346 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31314cf8-aec6-4abc-9020-210b19465aee tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:51.703856 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31314cf8-aec6-4abc-9020-210b19465aee tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:51.704550 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31314cf8-aec6-4abc-9020-210b19465aee tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:51.705001 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31314cf8-aec6-4abc-9020-210b19465aee tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:51.705468 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31314cf8-aec6-4abc-9020-210b19465aee tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:51.839562 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-31314cf8-aec6-4abc-9020-210b19465aee tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:51.847872 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-31314cf8-aec6-4abc-9020-210b19465aee tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764" status: 200 len: 1498 microversion: 2.1 time: 0.156762 Aug 26 15:58:51.848429 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 169/329] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:51 2022] GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764 => generated 1498 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:51.866278 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-5740f425-2714-45bc-9ce9-bd77fff0b736 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:51.866688 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-5740f425-2714-45bc-9ce9-bd77fff0b736 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:51.875711 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5740f425-2714-45bc-9ce9-bd77fff0b736 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:51.875711 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5740f425-2714-45bc-9ce9-bd77fff0b736 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:51.875711 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5740f425-2714-45bc-9ce9-bd77fff0b736 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:51.875711 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5740f425-2714-45bc-9ce9-bd77fff0b736 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:51.876063 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5740f425-2714-45bc-9ce9-bd77fff0b736 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:51.876063 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5740f425-2714-45bc-9ce9-bd77fff0b736 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:52.008649 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-5740f425-2714-45bc-9ce9-bd77fff0b736 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:52.016812 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-5740f425-2714-45bc-9ce9-bd77fff0b736 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:52.018249 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-5740f425-2714-45bc-9ce9-bd77fff0b736 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:52.019462 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-5740f425-2714-45bc-9ce9-bd77fff0b736 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.159485 Aug 26 15:58:52.019974 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 161/330] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:58:51 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:58:52.157540 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-31f6b2f7-60dc-4775-92e6-f7db7a2b1c47 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:52.158145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-31f6b2f7-60dc-4775-92e6-f7db7a2b1c47 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:52.164056 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31f6b2f7-60dc-4775-92e6-f7db7a2b1c47 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:52.164528 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31f6b2f7-60dc-4775-92e6-f7db7a2b1c47 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:52.164953 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31f6b2f7-60dc-4775-92e6-f7db7a2b1c47 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:52.165963 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31f6b2f7-60dc-4775-92e6-f7db7a2b1c47 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:52.166081 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31f6b2f7-60dc-4775-92e6-f7db7a2b1c47 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:52.166477 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31f6b2f7-60dc-4775-92e6-f7db7a2b1c47 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:52.299891 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-31f6b2f7-60dc-4775-92e6-f7db7a2b1c47 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:52.308385 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-31f6b2f7-60dc-4775-92e6-f7db7a2b1c47 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.154417 Aug 26 15:58:52.309164 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 170/331] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:52 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:53.044423 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-088256aa-f552-498c-b090-a40c75f598fd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:53.045041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-088256aa-f552-498c-b090-a40c75f598fd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:53.051900 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-088256aa-f552-498c-b090-a40c75f598fd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:53.052519 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-088256aa-f552-498c-b090-a40c75f598fd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:53.053021 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-088256aa-f552-498c-b090-a40c75f598fd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:53.053970 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-088256aa-f552-498c-b090-a40c75f598fd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:53.054512 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-088256aa-f552-498c-b090-a40c75f598fd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:53.055345 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-088256aa-f552-498c-b090-a40c75f598fd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:53.192389 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-088256aa-f552-498c-b090-a40c75f598fd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:53.201471 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-088256aa-f552-498c-b090-a40c75f598fd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:53.202914 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-088256aa-f552-498c-b090-a40c75f598fd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:53.204132 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-088256aa-f552-498c-b090-a40c75f598fd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.164618 Aug 26 15:58:53.204695 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 162/332] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:58:53 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:58:53.343555 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-cf94c4f1-5c2e-4434-b326-6c977ef994cb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:53.343555 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-cf94c4f1-5c2e-4434-b326-6c977ef994cb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:53.343555 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cf94c4f1-5c2e-4434-b326-6c977ef994cb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:53.343555 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cf94c4f1-5c2e-4434-b326-6c977ef994cb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:53.344415 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cf94c4f1-5c2e-4434-b326-6c977ef994cb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:53.344415 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cf94c4f1-5c2e-4434-b326-6c977ef994cb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:53.344415 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cf94c4f1-5c2e-4434-b326-6c977ef994cb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:53.344415 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cf94c4f1-5c2e-4434-b326-6c977ef994cb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:53.361690 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-27bb8085-1599-4538-ae25-d0430f4fcd7a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:53.362689 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-27bb8085-1599-4538-ae25-d0430f4fcd7a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 33640225-7b6b-41b9-af71-b8698d9b9764] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:53.369095 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-27bb8085-1599-4538-ae25-d0430f4fcd7a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:53.370819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-27bb8085-1599-4538-ae25-d0430f4fcd7a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:53.371541 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-27bb8085-1599-4538-ae25-d0430f4fcd7a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:53.372466 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-27bb8085-1599-4538-ae25-d0430f4fcd7a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:53.372983 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-27bb8085-1599-4538-ae25-d0430f4fcd7a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:53.373597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-27bb8085-1599-4538-ae25-d0430f4fcd7a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:53.408701 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-27bb8085-1599-4538-ae25-d0430f4fcd7a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 33640225-7b6b-41b9-af71-b8698d9b9764] Going to try to terminate instance {{(pid=128304) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 15:58:53.493090 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-cf94c4f1-5c2e-4434-b326-6c977ef994cb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:53.502197 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-cf94c4f1-5c2e-4434-b326-6c977ef994cb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.176407 Aug 26 15:58:53.502815 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 171/333] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:53 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:53.781250 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-27bb8085-1599-4538-ae25-d0430f4fcd7a tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "DELETE /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764" status: 204 len: 0 microversion: 2.1 time: 0.423136 Aug 26 15:58:53.781845 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 163/334] 10.222.0.94 () {58 vars in 1239 bytes} [Fri Aug 26 15:58:53 2022] DELETE /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 15:58:53.790242 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-49ad7911-2b6d-4e4e-9fd3-b052c7819bea tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:53.790783 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-49ad7911-2b6d-4e4e-9fd3-b052c7819bea tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 33640225-7b6b-41b9-af71-b8698d9b9764] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:53.797877 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-49ad7911-2b6d-4e4e-9fd3-b052c7819bea tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:53.798505 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-49ad7911-2b6d-4e4e-9fd3-b052c7819bea tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:53.798953 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-49ad7911-2b6d-4e4e-9fd3-b052c7819bea tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:53.799657 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-49ad7911-2b6d-4e4e-9fd3-b052c7819bea tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:53.800102 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-49ad7911-2b6d-4e4e-9fd3-b052c7819bea tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:53.800809 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-49ad7911-2b6d-4e4e-9fd3-b052c7819bea tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:53.949016 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-49ad7911-2b6d-4e4e-9fd3-b052c7819bea tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:53.957940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-49ad7911-2b6d-4e4e-9fd3-b052c7819bea tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764" status: 200 len: 1504 microversion: 2.1 time: 0.171594 Aug 26 15:58:53.958879 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 172/335] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:53 2022] GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764 => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:54.228609 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-aacbeb37-dfd1-46bd-adb8-77c3bb0fe205 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:54.229450 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-aacbeb37-dfd1-46bd-adb8-77c3bb0fe205 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:54.236461 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-aacbeb37-dfd1-46bd-adb8-77c3bb0fe205 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:54.237123 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-aacbeb37-dfd1-46bd-adb8-77c3bb0fe205 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:54.237751 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-aacbeb37-dfd1-46bd-adb8-77c3bb0fe205 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:54.238484 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-aacbeb37-dfd1-46bd-adb8-77c3bb0fe205 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:54.239098 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-aacbeb37-dfd1-46bd-adb8-77c3bb0fe205 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:54.239381 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-aacbeb37-dfd1-46bd-adb8-77c3bb0fe205 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:54.382820 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-aacbeb37-dfd1-46bd-adb8-77c3bb0fe205 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:54.391755 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-aacbeb37-dfd1-46bd-adb8-77c3bb0fe205 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:54.393242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-aacbeb37-dfd1-46bd-adb8-77c3bb0fe205 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:54.394406 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-aacbeb37-dfd1-46bd-adb8-77c3bb0fe205 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.170559 Aug 26 15:58:54.394970 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 164/336] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:58:54 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:58:54.523614 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-417b0300-d2c0-46af-83bf-dd48deb926f2 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:54.524215 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-417b0300-d2c0-46af-83bf-dd48deb926f2 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:54.531133 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-417b0300-d2c0-46af-83bf-dd48deb926f2 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:54.531611 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-417b0300-d2c0-46af-83bf-dd48deb926f2 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:54.532084 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-417b0300-d2c0-46af-83bf-dd48deb926f2 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:54.532815 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-417b0300-d2c0-46af-83bf-dd48deb926f2 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:54.533268 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-417b0300-d2c0-46af-83bf-dd48deb926f2 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:54.533690 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-417b0300-d2c0-46af-83bf-dd48deb926f2 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:54.552003 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:54.665471 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-417b0300-d2c0-46af-83bf-dd48deb926f2 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:54.674066 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-417b0300-d2c0-46af-83bf-dd48deb926f2 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.154335 Aug 26 15:58:54.674756 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 173/337] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:54 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:54.980416 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-a2fd2e52-5fac-4ab3-bcfb-0851002aff63 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:54.981229 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-a2fd2e52-5fac-4ab3-bcfb-0851002aff63 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 33640225-7b6b-41b9-af71-b8698d9b9764] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:54.987365 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a2fd2e52-5fac-4ab3-bcfb-0851002aff63 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:54.987852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a2fd2e52-5fac-4ab3-bcfb-0851002aff63 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:54.988292 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a2fd2e52-5fac-4ab3-bcfb-0851002aff63 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:54.988996 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a2fd2e52-5fac-4ab3-bcfb-0851002aff63 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:54.989454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a2fd2e52-5fac-4ab3-bcfb-0851002aff63 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:54.989878 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a2fd2e52-5fac-4ab3-bcfb-0851002aff63 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:55.154451 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-a2fd2e52-5fac-4ab3-bcfb-0851002aff63 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:55.164881 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-a2fd2e52-5fac-4ab3-bcfb-0851002aff63 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764" status: 200 len: 1504 microversion: 2.1 time: 0.188834 Aug 26 15:58:55.168122 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 165/338] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:54 2022] GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764 => generated 1504 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:55.420581 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a0d741be-0640-46e1-b96a-dbab75955874 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:55.420581 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a0d741be-0640-46e1-b96a-dbab75955874 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:55.429763 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a0d741be-0640-46e1-b96a-dbab75955874 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:55.430603 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a0d741be-0640-46e1-b96a-dbab75955874 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:55.431059 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a0d741be-0640-46e1-b96a-dbab75955874 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:55.432717 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a0d741be-0640-46e1-b96a-dbab75955874 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:55.433329 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a0d741be-0640-46e1-b96a-dbab75955874 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:55.433940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a0d741be-0640-46e1-b96a-dbab75955874 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:55.614144 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a0d741be-0640-46e1-b96a-dbab75955874 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:55.622616 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a0d741be-0640-46e1-b96a-dbab75955874 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:55.624061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a0d741be-0640-46e1-b96a-dbab75955874 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:55.625207 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a0d741be-0640-46e1-b96a-dbab75955874 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.209972 Aug 26 15:58:55.625755 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 174/339] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:58:55 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:58:55.696329 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-a18e18c7-e9f1-4be9-90c5-75db800c7994 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:55.696969 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-a18e18c7-e9f1-4be9-90c5-75db800c7994 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:55.704928 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a18e18c7-e9f1-4be9-90c5-75db800c7994 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:55.705419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a18e18c7-e9f1-4be9-90c5-75db800c7994 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:55.705881 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a18e18c7-e9f1-4be9-90c5-75db800c7994 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:55.706591 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a18e18c7-e9f1-4be9-90c5-75db800c7994 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:55.707143 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a18e18c7-e9f1-4be9-90c5-75db800c7994 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:55.707577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a18e18c7-e9f1-4be9-90c5-75db800c7994 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:55.868235 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-a18e18c7-e9f1-4be9-90c5-75db800c7994 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:55.877511 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-a18e18c7-e9f1-4be9-90c5-75db800c7994 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.185308 Aug 26 15:58:55.878156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 166/340] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:55 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:56.192990 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-9e5dd5a9-9d26-4078-be46-1b7570f175d5 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:56.194778 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-9e5dd5a9-9d26-4078-be46-1b7570f175d5 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 33640225-7b6b-41b9-af71-b8698d9b9764] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:56.202119 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9e5dd5a9-9d26-4078-be46-1b7570f175d5 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:56.202665 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9e5dd5a9-9d26-4078-be46-1b7570f175d5 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:56.203253 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9e5dd5a9-9d26-4078-be46-1b7570f175d5 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:56.204104 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9e5dd5a9-9d26-4078-be46-1b7570f175d5 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:56.204673 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9e5dd5a9-9d26-4078-be46-1b7570f175d5 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:56.205193 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9e5dd5a9-9d26-4078-be46-1b7570f175d5 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:56.364429 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-9e5dd5a9-9d26-4078-be46-1b7570f175d5 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:56.373041 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-9e5dd5a9-9d26-4078-be46-1b7570f175d5 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764" status: 200 len: 1504 microversion: 2.1 time: 0.185206 Aug 26 15:58:56.373609 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 175/341] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:56 2022] GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764 => generated 1504 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:56.649595 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-33bb72c4-9d76-46f1-8cfc-3b4e43655a9e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:56.650417 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-33bb72c4-9d76-46f1-8cfc-3b4e43655a9e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:56.657487 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-33bb72c4-9d76-46f1-8cfc-3b4e43655a9e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:56.658014 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-33bb72c4-9d76-46f1-8cfc-3b4e43655a9e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:56.658503 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-33bb72c4-9d76-46f1-8cfc-3b4e43655a9e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:56.659302 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-33bb72c4-9d76-46f1-8cfc-3b4e43655a9e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:56.659760 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-33bb72c4-9d76-46f1-8cfc-3b4e43655a9e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:56.660346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-33bb72c4-9d76-46f1-8cfc-3b4e43655a9e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:56.805651 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-33bb72c4-9d76-46f1-8cfc-3b4e43655a9e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:56.814635 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-33bb72c4-9d76-46f1-8cfc-3b4e43655a9e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:56.816114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-33bb72c4-9d76-46f1-8cfc-3b4e43655a9e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:56.817457 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-33bb72c4-9d76-46f1-8cfc-3b4e43655a9e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.172086 Aug 26 15:58:56.818162 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 167/342] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:58:56 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:58:56.900249 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-3659e00f-0ecd-48de-9f1e-bc98b616722e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:56.901445 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-3659e00f-0ecd-48de-9f1e-bc98b616722e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:56.908071 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3659e00f-0ecd-48de-9f1e-bc98b616722e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:56.908813 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3659e00f-0ecd-48de-9f1e-bc98b616722e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:56.909450 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3659e00f-0ecd-48de-9f1e-bc98b616722e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:56.910358 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3659e00f-0ecd-48de-9f1e-bc98b616722e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:56.910818 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3659e00f-0ecd-48de-9f1e-bc98b616722e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:56.911275 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3659e00f-0ecd-48de-9f1e-bc98b616722e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:57.061993 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-3659e00f-0ecd-48de-9f1e-bc98b616722e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:57.069967 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-3659e00f-0ecd-48de-9f1e-bc98b616722e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.174112 Aug 26 15:58:57.070575 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 176/343] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:56 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:57.396627 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-95cd71c8-6df9-451b-a7a9-ee2a5e0a61c2 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:57.397359 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-95cd71c8-6df9-451b-a7a9-ee2a5e0a61c2 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 33640225-7b6b-41b9-af71-b8698d9b9764] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:57.404350 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-95cd71c8-6df9-451b-a7a9-ee2a5e0a61c2 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:57.405067 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-95cd71c8-6df9-451b-a7a9-ee2a5e0a61c2 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:57.405557 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-95cd71c8-6df9-451b-a7a9-ee2a5e0a61c2 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:57.406297 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-95cd71c8-6df9-451b-a7a9-ee2a5e0a61c2 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:57.406827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-95cd71c8-6df9-451b-a7a9-ee2a5e0a61c2 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:57.407296 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-95cd71c8-6df9-451b-a7a9-ee2a5e0a61c2 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:57.824289 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-95cd71c8-6df9-451b-a7a9-ee2a5e0a61c2 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:57.832615 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-95cd71c8-6df9-451b-a7a9-ee2a5e0a61c2 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764" status: 200 len: 1504 microversion: 2.1 time: 0.439701 Aug 26 15:58:57.833228 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 168/344] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:57 2022] GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764 => generated 1504 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:57.842476 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-03d3b9aa-5f5e-4516-8f35-ac42ffc1eced tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:57.843301 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-03d3b9aa-5f5e-4516-8f35-ac42ffc1eced tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:57.850382 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-03d3b9aa-5f5e-4516-8f35-ac42ffc1eced tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:57.850971 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-03d3b9aa-5f5e-4516-8f35-ac42ffc1eced tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:57.851395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-03d3b9aa-5f5e-4516-8f35-ac42ffc1eced tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:57.852088 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-03d3b9aa-5f5e-4516-8f35-ac42ffc1eced tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:57.852531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-03d3b9aa-5f5e-4516-8f35-ac42ffc1eced tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:57.852945 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-03d3b9aa-5f5e-4516-8f35-ac42ffc1eced tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:58.050180 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-03d3b9aa-5f5e-4516-8f35-ac42ffc1eced tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:58.066275 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-03d3b9aa-5f5e-4516-8f35-ac42ffc1eced tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:58.071482 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-03d3b9aa-5f5e-4516-8f35-ac42ffc1eced tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:58.072690 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-03d3b9aa-5f5e-4516-8f35-ac42ffc1eced tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.234271 Aug 26 15:58:58.077602 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 177/345] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:58:57 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:58:58.093457 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-9a3424a1-bc39-4863-8d11-a0954eaf57a1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:58.094268 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-9a3424a1-bc39-4863-8d11-a0954eaf57a1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:58.102538 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9a3424a1-bc39-4863-8d11-a0954eaf57a1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:58.103129 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9a3424a1-bc39-4863-8d11-a0954eaf57a1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:58.115675 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9a3424a1-bc39-4863-8d11-a0954eaf57a1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:58.115675 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9a3424a1-bc39-4863-8d11-a0954eaf57a1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:58.115675 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9a3424a1-bc39-4863-8d11-a0954eaf57a1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:58.115675 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9a3424a1-bc39-4863-8d11-a0954eaf57a1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:58.149186 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-765b868b-4dee-4852-848b-c6d00edd3cf7 req-e0f3295a-33dd-4115-9640-2817d6678d49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33640225-7b6b-41b9-af71-b8698d9b9764", "name": "network-vif-deleted", "tag": "f4fa6357-1cb6-4a4e-8f53-16e01e325ce4"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:58:58.178885 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-765b868b-4dee-4852-848b-c6d00edd3cf7 req-e0f3295a-33dd-4115-9640-2817d6678d49 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:58.179403 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-765b868b-4dee-4852-848b-c6d00edd3cf7 req-e0f3295a-33dd-4115-9640-2817d6678d49 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:58.179837 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-765b868b-4dee-4852-848b-c6d00edd3cf7 req-e0f3295a-33dd-4115-9640-2817d6678d49 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:58.194906 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-765b868b-4dee-4852-848b-c6d00edd3cf7 req-e0f3295a-33dd-4115-9640-2817d6678d49 service nova] Creating event network-vif-deleted:f4fa6357-1cb6-4a4e-8f53-16e01e325ce4 for instance 33640225-7b6b-41b9-af71-b8698d9b9764 on hv-cinder-85144 Aug 26 15:58:58.200934 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-765b868b-4dee-4852-848b-c6d00edd3cf7 req-e0f3295a-33dd-4115-9640-2817d6678d49 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056224 Aug 26 15:58:58.201542 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 178/346] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 15:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:58:58.208846 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-b53f4466-435d-4f99-92b5-29e915563ef2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Action: 'create', calling method: .version_select at 0x7f15d97c6ca0>, body: {"keypair": {"name": "tempest-keypair-21028649", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9+AiutyWjzrETIe5sROSvC/8guLe8qwMCihuYaLEMeN38LEFS6O43qkj/1Ee/k9z5AUWOqKWG21ht116eDPOhu5QFbk5BMI9bslN1TNNtcJvec/ZvtfOIFgBO/trRa6Q=="}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:58:58.226583 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-b53f4466-435d-4f99-92b5-29e915563ef2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Getting quotas for project d95f731096d74a089f4161f5db69280c. Resources: {'key_pairs'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:58:58.232798 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-b53f4466-435d-4f99-92b5-29e915563ef2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Getting quotas for user b50041d36b0b430badd6442a2f09f063 and project d95f731096d74a089f4161f5db69280c. Resources: {'key_pairs'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:58:58.264865 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-9a3424a1-bc39-4863-8d11-a0954eaf57a1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:58.273422 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-9a3424a1-bc39-4863-8d11-a0954eaf57a1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1502 microversion: 2.1 time: 0.185282 Aug 26 15:58:58.277369 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 169/347] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:58 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1502 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:58:58.294555 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-840f298b-7f2c-4079-ae33-915bfd5e5eb4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b00cf0f9-a6cb-4ef5-931f-b0f8dca2cf35"}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:58:58.297028 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-840f298b-7f2c-4079-ae33-915bfd5e5eb4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:58.302908 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-840f298b-7f2c-4079-ae33-915bfd5e5eb4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:58.306722 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-840f298b-7f2c-4079-ae33-915bfd5e5eb4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:58.306722 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-840f298b-7f2c-4079-ae33-915bfd5e5eb4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:58.306722 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-840f298b-7f2c-4079-ae33-915bfd5e5eb4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:58.306722 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-840f298b-7f2c-4079-ae33-915bfd5e5eb4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:58.307846 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-840f298b-7f2c-4079-ae33-915bfd5e5eb4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:58.333142 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-840f298b-7f2c-4079-ae33-915bfd5e5eb4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] HTTP exception thrown: Cannot 'attach_volume' instance 18a7ee09-cb33-4638-a620-e36bc333cec6 while it is in vm_state rescued Aug 26 15:58:58.335315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-840f298b-7f2c-4079-ae33-915bfd5e5eb4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Request method failure captured: Aug 26 15:58:58.335315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: POST /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6/os-volume_attachments HTTP/1.1 Aug 26 15:58:58.335315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 15:58:58.335315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 15:58:58.335315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 15:58:58.335315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 74 Aug 26 15:58:58.335315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 15:58:58.335315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 15:58:58.335315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 15:58:58.335315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 15:58:58.335315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO0_sl285hvUjJgmI9tiwf2bPWJ_USKAuZl9qlXiPcbxQIVW1O_h2ghJjLWiyYPk1X7WhbLdFcB00PMIvtPLvDgRyMUSdg3tkWBfuoTGjVfkvNMUX-nJPvr_-GzeeJRuzdQ89_WhGnhJFkicXMewwKHJxRcDkRVBAc7d0S88NP2f2_c Aug 26 15:58:58.335315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 15:58:58.335315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 15:58:58.335315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 15:58:58.335315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 15:58:58.335315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 15:58:58.335315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 15:58:58.335315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: 5f170813ecff47a68d7610de9d769287 Aug 26 15:58:58.335315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1667711701 Aug 26 15:58:58.335315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 15:58:58.335315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 15:58:58.350193 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/5f170813ecff47a68d7610de9d769287"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/5f170813ecff47a68d7610de9d769287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/5f170813ecff47a68d7610de9d769287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_5f170813ecff47a68d7610de9d769287", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 15:58:58.350193 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1667711701 Aug 26 15:58:58.350193 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: 5f170813ecff47a68d7610de9d769287 Aug 26 15:58:58.350193 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1667711701 Aug 26 15:58:58.350193 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-ServerRescueNegativeTestJSON-1667711701-project Aug 26 15:58:58.350193 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 15:58:58.350193 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 15:58:58.350193 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: 4940f8a9c15a483eab251df392789534 Aug 26 15:58:58.350193 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1667711701-project Aug 26 15:58:58.350193 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Aug 26 15:58:58.350193 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {"volumeAttachment": {"volumeId": "b00cf0f9-a6cb-4ef5-931f-b0f8dca2cf35"}} Aug 26 15:58:58.350193 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: > Aug 26 15:58:58.351285 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Cannot 'attach_volume' instance 18a7ee09-cb33-4638-a620-e36bc333cec6 while it is in vm_state rescued Aug 26 15:58:58.351285 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'server_id': '18a7ee09-cb33-4638-a620-e36bc333cec6', 'body': {'volumeAttachment': {'volumeId': 'b00cf0f9-a6cb-4ef5-931f-b0f8dca2cf35'}}} Aug 26 15:58:58.351285 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:58:58.351285 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:58.351285 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 26 15:58:58.351285 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 26 15:58:58.351285 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 15:58:58.351285 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 15:58:58.351285 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 26 15:58:58.351285 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 26 15:58:58.351285 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 18a7ee09-cb33-4638-a620-e36bc333cec6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 26 15:58:58.351285 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 15:58:58.351285 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:58.351285 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 15:58:58.351285 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:58.351285 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:58.351285 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:58.351285 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:58:58.351285 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:58:58.352568 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:58:58.352568 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:58:58.352568 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 15:58:58.352568 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 15:58:58.352568 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 15:58:58.352568 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 15:58:58.352568 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 15:58:58.352568 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 15:58:58.352568 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 26 15:58:58.352568 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 26 15:58:58.352568 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 26 15:58:58.352568 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 26 15:58:58.352568 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 18a7ee09-cb33-4638-a620-e36bc333cec6 while it is in vm_state rescued Aug 26 15:58:58.352568 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 15:58:58.352568 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:58:58.352568 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 15:58:58.352568 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:58:58.352568 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:58:58.352568 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:58:58.357305 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:58:58.357305 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:58:58.357305 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 18a7ee09-cb33-4638-a620-e36bc333cec6 while it is in vm_state rescued Aug 26 15:58:58.357305 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 15:58:58.357658 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-b53f4466-435d-4f99-92b5-29e915563ef2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.131282 Aug 26 15:58:58.357745 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-840f298b-7f2c-4079-ae33-915bfd5e5eb4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Returning 409 to user: Cannot 'attach_volume' instance 18a7ee09-cb33-4638-a620-e36bc333cec6 while it is in vm_state rescued {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:58:58.357817 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 179/348] 10.222.0.94 () {60 vars in 1159 bytes} [Fri Aug 26 15:58:58 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:58:58.357884 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-840f298b-7f2c-4079-ae33-915bfd5e5eb4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "POST /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046965 Aug 26 15:58:58.357884 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 170/349] 10.222.0.94 () {60 vars in 1323 bytes} [Fri Aug 26 15:58:58 2022] POST /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 26 15:58:58.364776 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-601c987e-5017-4d53-bcec-9237a93daf9a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:58:58.365750 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-601c987e-5017-4d53-bcec-9237a93daf9a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:58.375556 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-601c987e-5017-4d53-bcec-9237a93daf9a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:58.376223 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-601c987e-5017-4d53-bcec-9237a93daf9a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:58.377275 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-601c987e-5017-4d53-bcec-9237a93daf9a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:58.377493 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-601c987e-5017-4d53-bcec-9237a93daf9a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:58.377788 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-601c987e-5017-4d53-bcec-9237a93daf9a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:58.378203 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-601c987e-5017-4d53-bcec-9237a93daf9a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:58.754632 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-601c987e-5017-4d53-bcec-9237a93daf9a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "POST /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6/action" status: 202 len: 0 microversion: 2.1 time: 0.405878 Aug 26 15:58:58.755753 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 180/350] 10.222.0.94 () {60 vars in 1278 bytes} [Fri Aug 26 15:58:58 2022] POST /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:58:58.764895 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-3673dc7f-8972-4354-bfda-b5cad8f48773 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:58.765853 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-3673dc7f-8972-4354-bfda-b5cad8f48773 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:58.774224 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3673dc7f-8972-4354-bfda-b5cad8f48773 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:58.774979 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3673dc7f-8972-4354-bfda-b5cad8f48773 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:58.775575 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3673dc7f-8972-4354-bfda-b5cad8f48773 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:58.777890 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3673dc7f-8972-4354-bfda-b5cad8f48773 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:58.778389 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3673dc7f-8972-4354-bfda-b5cad8f48773 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:58.778851 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3673dc7f-8972-4354-bfda-b5cad8f48773 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:58.854596 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-78919b4d-0683-43b0-8220-3fb7904667ea tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:58.855444 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-78919b4d-0683-43b0-8220-3fb7904667ea tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 33640225-7b6b-41b9-af71-b8698d9b9764] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:58.861882 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-78919b4d-0683-43b0-8220-3fb7904667ea tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:58.862459 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-78919b4d-0683-43b0-8220-3fb7904667ea tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:58.862998 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-78919b4d-0683-43b0-8220-3fb7904667ea tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:58.863766 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-78919b4d-0683-43b0-8220-3fb7904667ea tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:58.864291 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-78919b4d-0683-43b0-8220-3fb7904667ea tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:58.864781 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-78919b4d-0683-43b0-8220-3fb7904667ea tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:58.899849 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-78919b4d-0683-43b0-8220-3fb7904667ea tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:58.900594 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-78919b4d-0683-43b0-8220-3fb7904667ea tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:58.901893 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-78919b4d-0683-43b0-8220-3fb7904667ea tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:58.902348 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-78919b4d-0683-43b0-8220-3fb7904667ea tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lazy-loading 'fault' on Instance uuid 33640225-7b6b-41b9-af71-b8698d9b9764 {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:58:58.961154 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-3673dc7f-8972-4354-bfda-b5cad8f48773 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:58.972069 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-3673dc7f-8972-4354-bfda-b5cad8f48773 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1510 microversion: 2.1 time: 0.211776 Aug 26 15:58:58.972644 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 171/351] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:58 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1510 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:59.034162 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-78919b4d-0683-43b0-8220-3fb7904667ea tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:59.045616 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-78919b4d-0683-43b0-8220-3fb7904667ea tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764" status: 200 len: 1304 microversion: 2.1 time: 0.195476 Aug 26 15:58:59.048390 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 181/352] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:58 2022] GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764 => generated 1304 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:58:59.108063 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-183543ec-dd34-4a19-9ad8-1b96b8d271a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:59.108856 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-183543ec-dd34-4a19-9ad8-1b96b8d271a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:58:59.117157 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-183543ec-dd34-4a19-9ad8-1b96b8d271a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:59.117681 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-183543ec-dd34-4a19-9ad8-1b96b8d271a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:59.118125 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-183543ec-dd34-4a19-9ad8-1b96b8d271a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:59.126373 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-183543ec-dd34-4a19-9ad8-1b96b8d271a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:58:59.126373 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-183543ec-dd34-4a19-9ad8-1b96b8d271a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:58:59.126373 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-183543ec-dd34-4a19-9ad8-1b96b8d271a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:58:59.126912 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:58:59.341521 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-183543ec-dd34-4a19-9ad8-1b96b8d271a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:59.350710 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-183543ec-dd34-4a19-9ad8-1b96b8d271a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:59.352238 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-183543ec-dd34-4a19-9ad8-1b96b8d271a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:58:59.353511 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-183543ec-dd34-4a19-9ad8-1b96b8d271a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.257988 Aug 26 15:58:59.354715 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 172/353] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:58:59 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:58:59.995508 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-ebb17817-c148-41bf-a331-1ef454f7938f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:58:59.996211 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-ebb17817-c148-41bf-a331-1ef454f7938f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:00.003805 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ebb17817-c148-41bf-a331-1ef454f7938f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:00.004295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ebb17817-c148-41bf-a331-1ef454f7938f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:00.004735 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ebb17817-c148-41bf-a331-1ef454f7938f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:00.005435 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ebb17817-c148-41bf-a331-1ef454f7938f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:00.005891 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ebb17817-c148-41bf-a331-1ef454f7938f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:00.006327 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ebb17817-c148-41bf-a331-1ef454f7938f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:00.071874 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-acae6804-e4a4-4fb3-bf02-1cf56e415b73 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:00.073271 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-acae6804-e4a4-4fb3-bf02-1cf56e415b73 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 33640225-7b6b-41b9-af71-b8698d9b9764] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:00.080954 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-acae6804-e4a4-4fb3-bf02-1cf56e415b73 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:00.081525 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-acae6804-e4a4-4fb3-bf02-1cf56e415b73 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:00.082124 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-acae6804-e4a4-4fb3-bf02-1cf56e415b73 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:00.082903 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-acae6804-e4a4-4fb3-bf02-1cf56e415b73 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:00.083458 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-acae6804-e4a4-4fb3-bf02-1cf56e415b73 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:00.083973 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-acae6804-e4a4-4fb3-bf02-1cf56e415b73 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:00.117623 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-acae6804-e4a4-4fb3-bf02-1cf56e415b73 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:00.118214 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-acae6804-e4a4-4fb3-bf02-1cf56e415b73 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:00.118725 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-acae6804-e4a4-4fb3-bf02-1cf56e415b73 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:00.119272 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.objects.instance [None req-acae6804-e4a4-4fb3-bf02-1cf56e415b73 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lazy-loading 'fault' on Instance uuid 33640225-7b6b-41b9-af71-b8698d9b9764 {{(pid=128304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:59:00.190435 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-acae6804-e4a4-4fb3-bf02-1cf56e415b73 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe845d55b4b4ac898556dbdc264c086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff1702cbe6d41b196df47d78f148368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:00.212937 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-acae6804-e4a4-4fb3-bf02-1cf56e415b73 tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764" status: 200 len: 1304 microversion: 2.1 time: 0.144783 Aug 26 15:59:00.219456 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 173/354] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:00 2022] GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764 => generated 1304 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:00.290891 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-ebb17817-c148-41bf-a331-1ef454f7938f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:00.301058 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-ebb17817-c148-41bf-a331-1ef454f7938f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1510 microversion: 2.1 time: 0.311137 Aug 26 15:59:00.302557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 182/355] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:58:59 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1510 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:00.380822 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-2c5bc143-9d3a-44b1-8f9e-88e445aca77e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:00.381642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-2c5bc143-9d3a-44b1-8f9e-88e445aca77e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:00.388172 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:00.389843 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2c5bc143-9d3a-44b1-8f9e-88e445aca77e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:00.390344 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2c5bc143-9d3a-44b1-8f9e-88e445aca77e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:00.390776 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2c5bc143-9d3a-44b1-8f9e-88e445aca77e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:00.391696 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2c5bc143-9d3a-44b1-8f9e-88e445aca77e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:00.392409 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2c5bc143-9d3a-44b1-8f9e-88e445aca77e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:00.392748 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2c5bc143-9d3a-44b1-8f9e-88e445aca77e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:00.627878 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-2c5bc143-9d3a-44b1-8f9e-88e445aca77e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:00.637139 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-2c5bc143-9d3a-44b1-8f9e-88e445aca77e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:00.639423 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-2c5bc143-9d3a-44b1-8f9e-88e445aca77e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:00.640775 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-2c5bc143-9d3a-44b1-8f9e-88e445aca77e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.267281 Aug 26 15:59:00.641523 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 174/356] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:00 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:01.234045 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a5857dcd-4464-41cb-8987-038a2acb6baa tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:01.234656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a5857dcd-4464-41cb-8987-038a2acb6baa tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] [instance: 33640225-7b6b-41b9-af71-b8698d9b9764] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:01.241055 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a5857dcd-4464-41cb-8987-038a2acb6baa tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:01.241521 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a5857dcd-4464-41cb-8987-038a2acb6baa tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:01.241950 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a5857dcd-4464-41cb-8987-038a2acb6baa tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:01.242634 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a5857dcd-4464-41cb-8987-038a2acb6baa tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:01.243135 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a5857dcd-4464-41cb-8987-038a2acb6baa tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:01.243559 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a5857dcd-4464-41cb-8987-038a2acb6baa tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:01.257652 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.wsgi [None req-a5857dcd-4464-41cb-8987-038a2acb6baa tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] HTTP exception thrown: Instance 33640225-7b6b-41b9-af71-b8698d9b9764 could not be found. Aug 26 15:59:01.259347 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a5857dcd-4464-41cb-8987-038a2acb6baa tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Request method failure captured: Aug 26 15:59:01.259347 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: request: GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764 HTTP/1.1 Aug 26 15:59:01.259347 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept: application/json Aug 26 15:59:01.259347 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept-Encoding: identity Aug 26 15:59:01.259347 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Connection: close Aug 26 15:59:01.259347 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Length: 0 Aug 26 15:59:01.259347 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Type: application/json Aug 26 15:59:01.259347 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Host: 10.222.0.94 Aug 26 15:59:01.259347 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Openstack-System-Scope: None Aug 26 15:59:01.259347 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: User-Agent: python-urllib3/1.26.11 Aug 26 15:59:01.259347 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Auth-Token: gAAAAABjCO2HtEBtYidKC0yaENr7iF8WVU36omnMdJEd6RS-9GkPRYe8311G1iTVk8hCfuJP8S_8SiVnovHOJnqbpj9oW2SPe0xUeDaluoz_wDml-BXu5UpBfL7PNh0KPwVE2jAW5B_CYtFSR8K48ydwAWOQwZZqI0mh2kCdaW8RjefwBno9oXE Aug 26 15:59:01.259347 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Id: None Aug 26 15:59:01.259347 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Name: None Aug 26 15:59:01.259347 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Identity-Status: Confirmed Aug 26 15:59:01.259347 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Is-Admin-Project: True Aug 26 15:59:01.259347 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Id: default Aug 26 15:59:01.259347 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Name: Default Aug 26 15:59:01.259347 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Id: 2ff1702cbe6d41b196df47d78f148368 Aug 26 15:59:01.259347 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Name: tempest-VolumesActionsTest-2123347964 Aug 26 15:59:01.259347 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Role: member,reader Aug 26 15:59:01.259347 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Roles: member,reader Aug 26 15:59:01.261011 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/2ff1702cbe6d41b196df47d78f148368"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/2ff1702cbe6d41b196df47d78f148368"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/2ff1702cbe6d41b196df47d78f148368"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_2ff1702cbe6d41b196df47d78f148368", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 15:59:01.261011 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant: tempest-VolumesActionsTest-2123347964 Aug 26 15:59:01.261011 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Id: 2ff1702cbe6d41b196df47d78f148368 Aug 26 15:59:01.261011 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Name: tempest-VolumesActionsTest-2123347964 Aug 26 15:59:01.261011 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User: tempest-VolumesActionsTest-2123347964-project Aug 26 15:59:01.261011 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Id: default Aug 26 15:59:01.261011 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Name: Default Aug 26 15:59:01.261011 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Id: abe845d55b4b4ac898556dbdc264c086 Aug 26 15:59:01.261011 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Name: tempest-VolumesActionsTest-2123347964-project Aug 26 15:59:01.261011 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: method: > Aug 26 15:59:01.261011 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: exception: Instance 33640225-7b6b-41b9-af71-b8698d9b9764 could not be found. Aug 26 15:59:01.261011 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: action_args: {'id': '33640225-7b6b-41b9-af71-b8698d9b9764'} Aug 26 15:59:01.261829 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 15:59:01.261829 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:59:01.261829 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 15:59:01.261829 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 15:59:01.261829 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 15:59:01.261829 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 15:59:01.261829 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 15:59:01.261829 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 15:59:01.261829 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 15:59:01.261829 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 15:59:01.261829 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33640225-7b6b-41b9-af71-b8698d9b9764 could not be found. Aug 26 15:59:01.261829 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 15:59:01.261829 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:59:01.261829 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 15:59:01.261829 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:59:01.261829 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:59:01.261829 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:59:01.261829 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 15:59:01.261829 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 15:59:01.261829 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 15:59:01.263016 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 15:59:01.263016 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 15:59:01.263016 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 15:59:01.263016 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 15:59:01.263016 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 15:59:01.263016 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 15:59:01.263016 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 15:59:01.263016 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33640225-7b6b-41b9-af71-b8698d9b9764 could not be found. Aug 26 15:59:01.263016 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 15:59:01.263016 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 15:59:01.263016 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 15:59:01.263016 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 15:59:01.263016 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 15:59:01.263016 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 15:59:01.263016 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 15:59:01.263016 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 15:59:01.263016 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33640225-7b6b-41b9-af71-b8698d9b9764 could not be found. Aug 26 15:59:01.263016 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 15:59:01.263979 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a5857dcd-4464-41cb-8987-038a2acb6baa tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] Returning 404 to user: Instance 33640225-7b6b-41b9-af71-b8698d9b9764 could not be found. {{(pid=128305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 15:59:01.263979 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a5857dcd-4464-41cb-8987-038a2acb6baa tempest-VolumesActionsTest-2123347964 tempest-VolumesActionsTest-2123347964-project] 10.222.0.94 "GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764" status: 404 len: 111 microversion: 2.1 time: 0.031062 Aug 26 15:59:01.263979 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 183/357] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:01 2022] GET /compute/v2.1/servers/33640225-7b6b-41b9-af71-b8698d9b9764 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 15:59:01.333757 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-983a1afe-2975-43c0-9f67-6e378ecde75c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:01.335038 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-983a1afe-2975-43c0-9f67-6e378ecde75c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:01.341756 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-983a1afe-2975-43c0-9f67-6e378ecde75c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:01.342250 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-983a1afe-2975-43c0-9f67-6e378ecde75c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:01.342707 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-983a1afe-2975-43c0-9f67-6e378ecde75c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:01.343450 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-983a1afe-2975-43c0-9f67-6e378ecde75c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:01.343908 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-983a1afe-2975-43c0-9f67-6e378ecde75c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:01.344334 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-983a1afe-2975-43c0-9f67-6e378ecde75c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:01.503623 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-983a1afe-2975-43c0-9f67-6e378ecde75c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:01.512609 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-983a1afe-2975-43c0-9f67-6e378ecde75c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1510 microversion: 2.1 time: 0.187891 Aug 26 15:59:01.514763 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 175/358] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:01 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1510 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:01.665253 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-9e141776-6703-4edb-8a50-8dc320703c89 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:01.666019 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-9e141776-6703-4edb-8a50-8dc320703c89 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:01.674121 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9e141776-6703-4edb-8a50-8dc320703c89 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:01.674958 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9e141776-6703-4edb-8a50-8dc320703c89 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:01.675588 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9e141776-6703-4edb-8a50-8dc320703c89 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:01.676547 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9e141776-6703-4edb-8a50-8dc320703c89 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:01.677648 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9e141776-6703-4edb-8a50-8dc320703c89 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:01.678292 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9e141776-6703-4edb-8a50-8dc320703c89 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:01.723097 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-c45efdc1-5094-46aa-aac9-8b1c0c35e7ae tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-441222321", "imageRef": "bcbdbb0c-7335-4427-a636-e2dc730274b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62414327-5b31-4d4a-b372-9a9bbc06aa9d"}], "security_groups": [{"name": "tempest-securitygroup--1140601955"}], "key_name": "tempest-keypair-21028649", "user_data": "}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:59:01.867296 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-9e141776-6703-4edb-8a50-8dc320703c89 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:01.876885 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-9e141776-6703-4edb-8a50-8dc320703c89 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:01.878437 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-9e141776-6703-4edb-8a50-8dc320703c89 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:01.879760 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-9e141776-6703-4edb-8a50-8dc320703c89 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.218669 Aug 26 15:59:01.880313 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 184/359] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:01 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:01.881240 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.network.neutron [None req-c45efdc1-5094-46aa-aac9-8b1c0c35e7ae tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] validate_networks() for [('62414327-5b31-4d4a-b372-9a9bbc06aa9d', None, None, None, None, None)] {{(pid=128304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:59:02.283922 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-c45efdc1-5094-46aa-aac9-8b1c0c35e7ae tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Flavor limits 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:59:02.284358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-c45efdc1-5094-46aa-aac9-8b1c0c35e7ae tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Image limits 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:59:02.284825 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-c45efdc1-5094-46aa-aac9-8b1c0c35e7ae tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Flavor pref 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:59:02.285226 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-c45efdc1-5094-46aa-aac9-8b1c0c35e7ae tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Image pref 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:59:02.285641 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-c45efdc1-5094-46aa-aac9-8b1c0c35e7ae tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:59:02.294695 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c45efdc1-5094-46aa-aac9-8b1c0c35e7ae tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:02.295190 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c45efdc1-5094-46aa-aac9-8b1c0c35e7ae tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:02.295627 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c45efdc1-5094-46aa-aac9-8b1c0c35e7ae tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:02.296350 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c45efdc1-5094-46aa-aac9-8b1c0c35e7ae tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:02.296798 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c45efdc1-5094-46aa-aac9-8b1c0c35e7ae tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:02.297218 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c45efdc1-5094-46aa-aac9-8b1c0c35e7ae tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:02.314827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-c45efdc1-5094-46aa-aac9-8b1c0c35e7ae tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Getting quotas for project d95f731096d74a089f4161f5db69280c. Resources: {'instances', 'ram', 'cores'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:59:02.318946 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-c45efdc1-5094-46aa-aac9-8b1c0c35e7ae tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Getting quotas for user b50041d36b0b430badd6442a2f09f063 and project d95f731096d74a089f4161f5db69280c. Resources: {'instances', 'ram', 'cores'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:59:02.331922 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-c45efdc1-5094-46aa-aac9-8b1c0c35e7ae tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Going to run 1 instances... {{(pid=128304) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:59:02.336258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-c45efdc1-5094-46aa-aac9-8b1c0c35e7ae tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bcbdbb0c-7335-4427-a636-e2dc730274b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:59:02.510039 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-c45efdc1-5094-46aa-aac9-8b1c0c35e7ae tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.787366 Aug 26 15:59:02.510039 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 176/360] 10.222.0.94 () {60 vars in 1147 bytes} [Fri Aug 26 15:59:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 15:59:02.518268 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-d3de0ff9-8cc2-4b05-95c5-4a19b6bec024 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:02.518875 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-d3de0ff9-8cc2-4b05-95c5-4a19b6bec024 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:02.535859 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-577e180e-f117-44f1-b4c7-c05e755866e6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:02.549355 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-577e180e-f117-44f1-b4c7-c05e755866e6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:02.564393 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-577e180e-f117-44f1-b4c7-c05e755866e6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:02.565077 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-577e180e-f117-44f1-b4c7-c05e755866e6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:02.565531 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-577e180e-f117-44f1-b4c7-c05e755866e6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:02.570118 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-577e180e-f117-44f1-b4c7-c05e755866e6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:02.570611 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-577e180e-f117-44f1-b4c7-c05e755866e6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:02.571090 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-577e180e-f117-44f1-b4c7-c05e755866e6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:02.602206 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d3de0ff9-8cc2-4b05-95c5-4a19b6bec024 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:02.620115 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-d3de0ff9-8cc2-4b05-95c5-4a19b6bec024 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1239 microversion: 2.1 time: 0.105071 Aug 26 15:59:02.621096 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 185/361] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:02 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1239 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:02.749197 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-577e180e-f117-44f1-b4c7-c05e755866e6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:02.758343 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-577e180e-f117-44f1-b4c7-c05e755866e6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1516 microversion: 2.1 time: 0.226785 Aug 26 15:59:02.758911 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 177/362] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:02 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1516 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:02.903905 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-6a16530c-d4ce-4454-a514-95b380c141d3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:02.904511 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-6a16530c-d4ce-4454-a514-95b380c141d3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:02.910417 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6a16530c-d4ce-4454-a514-95b380c141d3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:02.910896 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6a16530c-d4ce-4454-a514-95b380c141d3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:02.911359 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6a16530c-d4ce-4454-a514-95b380c141d3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:02.912359 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6a16530c-d4ce-4454-a514-95b380c141d3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:02.912815 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6a16530c-d4ce-4454-a514-95b380c141d3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:02.913238 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6a16530c-d4ce-4454-a514-95b380c141d3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:03.067125 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-6a16530c-d4ce-4454-a514-95b380c141d3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:03.079656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-6a16530c-d4ce-4454-a514-95b380c141d3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:03.081242 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-6a16530c-d4ce-4454-a514-95b380c141d3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:03.082319 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-6a16530c-d4ce-4454-a514-95b380c141d3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.183393 Aug 26 15:59:03.086604 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 186/363] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:02 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:03.640815 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-317387a9-2995-4eb2-a1ef-66afe8e32451 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:03.641437 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-317387a9-2995-4eb2-a1ef-66afe8e32451 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:03.697801 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-317387a9-2995-4eb2-a1ef-66afe8e32451 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:03.705377 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-317387a9-2995-4eb2-a1ef-66afe8e32451 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1239 microversion: 2.1 time: 0.068558 Aug 26 15:59:03.705946 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 178/364] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:03 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:04.232569 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-cc28339e-9e8c-4a6e-81e3-0123c7d6fa13 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:04.232569 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-cc28339e-9e8c-4a6e-81e3-0123c7d6fa13 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:04.232569 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cc28339e-9e8c-4a6e-81e3-0123c7d6fa13 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:04.232569 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cc28339e-9e8c-4a6e-81e3-0123c7d6fa13 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:04.233218 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cc28339e-9e8c-4a6e-81e3-0123c7d6fa13 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:04.233218 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cc28339e-9e8c-4a6e-81e3-0123c7d6fa13 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:04.233218 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cc28339e-9e8c-4a6e-81e3-0123c7d6fa13 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:04.233218 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cc28339e-9e8c-4a6e-81e3-0123c7d6fa13 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:04.247002 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-cc28339e-9e8c-4a6e-81e3-0123c7d6fa13 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:04.257740 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-cc28339e-9e8c-4a6e-81e3-0123c7d6fa13 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:04.259292 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-cc28339e-9e8c-4a6e-81e3-0123c7d6fa13 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:04.266517 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-cc28339e-9e8c-4a6e-81e3-0123c7d6fa13 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.159157 Aug 26 15:59:04.266517 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 187/365] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:04 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:04.726620 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-3dc10ee0-e362-4d02-9e66-c48fadcbb131 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:04.727291 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-3dc10ee0-e362-4d02-9e66-c48fadcbb131 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:04.737136 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3dc10ee0-e362-4d02-9e66-c48fadcbb131 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:04.737684 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3dc10ee0-e362-4d02-9e66-c48fadcbb131 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:04.738106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3dc10ee0-e362-4d02-9e66-c48fadcbb131 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:04.738809 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3dc10ee0-e362-4d02-9e66-c48fadcbb131 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:04.739295 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3dc10ee0-e362-4d02-9e66-c48fadcbb131 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:04.739724 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3dc10ee0-e362-4d02-9e66-c48fadcbb131 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:04.803621 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-3dc10ee0-e362-4d02-9e66-c48fadcbb131 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:04.812134 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-3dc10ee0-e362-4d02-9e66-c48fadcbb131 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1243 microversion: 2.1 time: 0.089350 Aug 26 15:59:04.813547 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 179/366] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:04 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1243 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:05.284635 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-b5e1b092-039f-43cd-b85a-8265bfac2e5f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:05.285275 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-b5e1b092-039f-43cd-b85a-8265bfac2e5f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:05.292976 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b5e1b092-039f-43cd-b85a-8265bfac2e5f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:05.293462 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b5e1b092-039f-43cd-b85a-8265bfac2e5f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:05.293896 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b5e1b092-039f-43cd-b85a-8265bfac2e5f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:05.294610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b5e1b092-039f-43cd-b85a-8265bfac2e5f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:05.295093 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b5e1b092-039f-43cd-b85a-8265bfac2e5f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:05.295549 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b5e1b092-039f-43cd-b85a-8265bfac2e5f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:05.431453 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b5e1b092-039f-43cd-b85a-8265bfac2e5f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:05.439994 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b5e1b092-039f-43cd-b85a-8265bfac2e5f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:05.441431 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b5e1b092-039f-43cd-b85a-8265bfac2e5f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:05.442583 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-b5e1b092-039f-43cd-b85a-8265bfac2e5f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.161850 Aug 26 15:59:05.443177 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 188/367] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:05 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:05.833698 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-58911512-5869-4c97-9b6d-d46a9d2b00d8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:05.834230 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-58911512-5869-4c97-9b6d-d46a9d2b00d8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:05.840757 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-58911512-5869-4c97-9b6d-d46a9d2b00d8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:05.841240 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-58911512-5869-4c97-9b6d-d46a9d2b00d8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:05.841677 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-58911512-5869-4c97-9b6d-d46a9d2b00d8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:05.842370 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-58911512-5869-4c97-9b6d-d46a9d2b00d8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:05.842824 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-58911512-5869-4c97-9b6d-d46a9d2b00d8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:05.843386 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-58911512-5869-4c97-9b6d-d46a9d2b00d8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:05.920849 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-58911512-5869-4c97-9b6d-d46a9d2b00d8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:05.920849 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-58911512-5869-4c97-9b6d-d46a9d2b00d8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1243 microversion: 2.1 time: 0.089196 Aug 26 15:59:05.920849 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 180/368] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:05 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1243 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:06.467184 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-f4cc4244-66e5-4455-8ccc-fd871c5fc5ab tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:06.468629 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-f4cc4244-66e5-4455-8ccc-fd871c5fc5ab tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:06.470196 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=1 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:06.475123 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f4cc4244-66e5-4455-8ccc-fd871c5fc5ab tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:06.475611 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f4cc4244-66e5-4455-8ccc-fd871c5fc5ab tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:06.476049 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f4cc4244-66e5-4455-8ccc-fd871c5fc5ab tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:06.476809 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f4cc4244-66e5-4455-8ccc-fd871c5fc5ab tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:06.477265 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f4cc4244-66e5-4455-8ccc-fd871c5fc5ab tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:06.477690 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f4cc4244-66e5-4455-8ccc-fd871c5fc5ab tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:06.619085 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-f4cc4244-66e5-4455-8ccc-fd871c5fc5ab tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:06.627834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-f4cc4244-66e5-4455-8ccc-fd871c5fc5ab tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:06.629255 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-f4cc4244-66e5-4455-8ccc-fd871c5fc5ab tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:06.630427 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-f4cc4244-66e5-4455-8ccc-fd871c5fc5ab tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.167749 Aug 26 15:59:06.631007 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 189/369] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:06 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:06.939983 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-69019fca-3080-448f-a660-83bd4dac5de6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:06.941696 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-69019fca-3080-448f-a660-83bd4dac5de6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:06.948199 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-69019fca-3080-448f-a660-83bd4dac5de6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:06.948684 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-69019fca-3080-448f-a660-83bd4dac5de6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:06.949111 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-69019fca-3080-448f-a660-83bd4dac5de6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:06.949911 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-69019fca-3080-448f-a660-83bd4dac5de6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:06.950627 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-69019fca-3080-448f-a660-83bd4dac5de6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:06.951145 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-69019fca-3080-448f-a660-83bd4dac5de6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:07.015150 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-69019fca-3080-448f-a660-83bd4dac5de6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:07.023444 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-69019fca-3080-448f-a660-83bd4dac5de6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1243 microversion: 2.1 time: 0.086910 Aug 26 15:59:07.027923 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 181/370] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:06 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1243 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:07.654410 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-7ad59705-39a1-4fc0-af2d-2d2e39fc6efe tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:07.655260 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-7ad59705-39a1-4fc0-af2d-2d2e39fc6efe tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:07.661777 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7ad59705-39a1-4fc0-af2d-2d2e39fc6efe tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:07.662262 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7ad59705-39a1-4fc0-af2d-2d2e39fc6efe tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:07.662700 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7ad59705-39a1-4fc0-af2d-2d2e39fc6efe tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:07.663456 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7ad59705-39a1-4fc0-af2d-2d2e39fc6efe tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:07.663906 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7ad59705-39a1-4fc0-af2d-2d2e39fc6efe tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:07.664328 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7ad59705-39a1-4fc0-af2d-2d2e39fc6efe tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:07.802098 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-7ad59705-39a1-4fc0-af2d-2d2e39fc6efe tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:07.810798 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-7ad59705-39a1-4fc0-af2d-2d2e39fc6efe tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:07.812270 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-7ad59705-39a1-4fc0-af2d-2d2e39fc6efe tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:07.813429 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-7ad59705-39a1-4fc0-af2d-2d2e39fc6efe tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.163678 Aug 26 15:59:07.813988 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 190/371] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:07 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:08.045421 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-79632df3-f6b9-4bba-a880-0ebb4a0a66c8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:08.046039 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-79632df3-f6b9-4bba-a880-0ebb4a0a66c8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:08.052564 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-79632df3-f6b9-4bba-a880-0ebb4a0a66c8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:08.058281 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-79632df3-f6b9-4bba-a880-0ebb4a0a66c8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:08.058281 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-79632df3-f6b9-4bba-a880-0ebb4a0a66c8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:08.058281 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-79632df3-f6b9-4bba-a880-0ebb4a0a66c8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:08.058281 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-79632df3-f6b9-4bba-a880-0ebb4a0a66c8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:08.058671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-79632df3-f6b9-4bba-a880-0ebb4a0a66c8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:08.125838 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-79632df3-f6b9-4bba-a880-0ebb4a0a66c8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:08.133622 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-79632df3-f6b9-4bba-a880-0ebb4a0a66c8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1243 microversion: 2.1 time: 0.092997 Aug 26 15:59:08.143319 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 182/372] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:08 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1243 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:08.836418 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-57da2359-e842-49d2-9e60-9969ea3ad64c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:08.836955 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-57da2359-e842-49d2-9e60-9969ea3ad64c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:08.843992 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-57da2359-e842-49d2-9e60-9969ea3ad64c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:08.844464 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-57da2359-e842-49d2-9e60-9969ea3ad64c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:08.844888 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-57da2359-e842-49d2-9e60-9969ea3ad64c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:08.845561 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-57da2359-e842-49d2-9e60-9969ea3ad64c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:08.846094 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-57da2359-e842-49d2-9e60-9969ea3ad64c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:08.846511 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-57da2359-e842-49d2-9e60-9969ea3ad64c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:08.979520 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-57da2359-e842-49d2-9e60-9969ea3ad64c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:08.988247 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-57da2359-e842-49d2-9e60-9969ea3ad64c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:08.989708 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-57da2359-e842-49d2-9e60-9969ea3ad64c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:08.990878 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-57da2359-e842-49d2-9e60-9969ea3ad64c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.158378 Aug 26 15:59:08.991462 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 191/373] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:08 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:09.157319 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-64ffa056-d82f-4907-aa89-018ee201c83f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:09.157933 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-64ffa056-d82f-4907-aa89-018ee201c83f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:09.164639 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-64ffa056-d82f-4907-aa89-018ee201c83f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:09.165092 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-64ffa056-d82f-4907-aa89-018ee201c83f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:09.165458 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-64ffa056-d82f-4907-aa89-018ee201c83f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:09.166878 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-64ffa056-d82f-4907-aa89-018ee201c83f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:09.167518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-64ffa056-d82f-4907-aa89-018ee201c83f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:09.167955 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-64ffa056-d82f-4907-aa89-018ee201c83f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:09.231033 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-64ffa056-d82f-4907-aa89-018ee201c83f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:09.241022 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-64ffa056-d82f-4907-aa89-018ee201c83f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1243 microversion: 2.1 time: 0.087618 Aug 26 15:59:09.241688 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 183/374] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:09 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1243 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:10.013813 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-b5f2cb02-9f0d-4526-becd-e7d1ab01802d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:10.014411 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-b5f2cb02-9f0d-4526-becd-e7d1ab01802d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:10.020889 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b5f2cb02-9f0d-4526-becd-e7d1ab01802d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:10.021369 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b5f2cb02-9f0d-4526-becd-e7d1ab01802d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:10.021859 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b5f2cb02-9f0d-4526-becd-e7d1ab01802d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:10.022497 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b5f2cb02-9f0d-4526-becd-e7d1ab01802d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:10.022963 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b5f2cb02-9f0d-4526-becd-e7d1ab01802d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:10.023389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b5f2cb02-9f0d-4526-becd-e7d1ab01802d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:10.027621 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:10.162816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b5f2cb02-9f0d-4526-becd-e7d1ab01802d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:10.171922 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b5f2cb02-9f0d-4526-becd-e7d1ab01802d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:10.173354 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b5f2cb02-9f0d-4526-becd-e7d1ab01802d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:10.174509 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-b5f2cb02-9f0d-4526-becd-e7d1ab01802d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.164734 Aug 26 15:59:10.175095 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 192/375] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:10 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:10.262029 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ce2a2444-7fe1-46dc-892f-00335a848422 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:10.263381 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ce2a2444-7fe1-46dc-892f-00335a848422 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:10.281783 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ce2a2444-7fe1-46dc-892f-00335a848422 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:10.282439 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ce2a2444-7fe1-46dc-892f-00335a848422 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:10.282944 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ce2a2444-7fe1-46dc-892f-00335a848422 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:10.283733 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ce2a2444-7fe1-46dc-892f-00335a848422 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:10.284255 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ce2a2444-7fe1-46dc-892f-00335a848422 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:10.284748 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ce2a2444-7fe1-46dc-892f-00335a848422 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:10.369266 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-ce2a2444-7fe1-46dc-892f-00335a848422 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:10.377189 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ce2a2444-7fe1-46dc-892f-00335a848422 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1243 microversion: 2.1 time: 0.119439 Aug 26 15:59:10.377913 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 184/376] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:10 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1243 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:11.198503 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a701e7af-e7fe-41d3-ad77-577a2a4bb343 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:11.199130 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a701e7af-e7fe-41d3-ad77-577a2a4bb343 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:11.205503 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a701e7af-e7fe-41d3-ad77-577a2a4bb343 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:11.205980 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a701e7af-e7fe-41d3-ad77-577a2a4bb343 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:11.206414 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a701e7af-e7fe-41d3-ad77-577a2a4bb343 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:11.207122 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a701e7af-e7fe-41d3-ad77-577a2a4bb343 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:11.207568 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a701e7af-e7fe-41d3-ad77-577a2a4bb343 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:11.207988 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a701e7af-e7fe-41d3-ad77-577a2a4bb343 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:11.339765 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a701e7af-e7fe-41d3-ad77-577a2a4bb343 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:11.348378 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a701e7af-e7fe-41d3-ad77-577a2a4bb343 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:11.349803 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a701e7af-e7fe-41d3-ad77-577a2a4bb343 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:11.350978 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a701e7af-e7fe-41d3-ad77-577a2a4bb343 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.156435 Aug 26 15:59:11.351531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 193/377] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:11 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:59:11.398183 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-260491cc-900a-4654-bb03-e130abd7cc31 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:11.398798 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-260491cc-900a-4654-bb03-e130abd7cc31 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:11.406474 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-260491cc-900a-4654-bb03-e130abd7cc31 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:11.406986 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-260491cc-900a-4654-bb03-e130abd7cc31 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:11.407425 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-260491cc-900a-4654-bb03-e130abd7cc31 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:11.408122 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-260491cc-900a-4654-bb03-e130abd7cc31 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:11.408574 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-260491cc-900a-4654-bb03-e130abd7cc31 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:11.408998 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-260491cc-900a-4654-bb03-e130abd7cc31 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:11.477146 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-260491cc-900a-4654-bb03-e130abd7cc31 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:11.485094 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-260491cc-900a-4654-bb03-e130abd7cc31 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1243 microversion: 2.1 time: 0.090686 Aug 26 15:59:11.485665 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 185/378] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:11 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1243 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:12.377049 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-d15c5304-3035-43df-9abe-e90c1f6662b9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:12.377636 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-d15c5304-3035-43df-9abe-e90c1f6662b9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:12.386947 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d15c5304-3035-43df-9abe-e90c1f6662b9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:12.387443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d15c5304-3035-43df-9abe-e90c1f6662b9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:12.387950 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d15c5304-3035-43df-9abe-e90c1f6662b9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:12.388671 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d15c5304-3035-43df-9abe-e90c1f6662b9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:12.389246 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d15c5304-3035-43df-9abe-e90c1f6662b9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:12.389686 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d15c5304-3035-43df-9abe-e90c1f6662b9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:12.505867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-abe9f14d-d0ac-41ff-9f21-28418f413c39 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:12.506534 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-abe9f14d-d0ac-41ff-9f21-28418f413c39 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:12.508558 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell0:SELECT=2 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:12.514353 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-abe9f14d-d0ac-41ff-9f21-28418f413c39 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:12.515011 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-abe9f14d-d0ac-41ff-9f21-28418f413c39 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:12.515786 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-abe9f14d-d0ac-41ff-9f21-28418f413c39 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:12.517237 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-abe9f14d-d0ac-41ff-9f21-28418f413c39 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:12.517756 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-abe9f14d-d0ac-41ff-9f21-28418f413c39 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:12.518246 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-abe9f14d-d0ac-41ff-9f21-28418f413c39 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:12.543959 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d15c5304-3035-43df-9abe-e90c1f6662b9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:12.543959 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d15c5304-3035-43df-9abe-e90c1f6662b9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:12.544301 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d15c5304-3035-43df-9abe-e90c1f6662b9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:12.544945 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-d15c5304-3035-43df-9abe-e90c1f6662b9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.172707 Aug 26 15:59:12.545871 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 194/379] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:12 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:12.581831 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-abe9f14d-d0ac-41ff-9f21-28418f413c39 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:12.590212 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-abe9f14d-d0ac-41ff-9f21-28418f413c39 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1243 microversion: 2.1 time: 0.088219 Aug 26 15:59:12.590788 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 186/380] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:12 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1243 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:13.570196 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-25e7d6d7-752a-45c4-b1d3-e3825dd1ccdd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:13.571446 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-25e7d6d7-752a-45c4-b1d3-e3825dd1ccdd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:13.578054 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell0:SELECT=6 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:13.580790 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-25e7d6d7-752a-45c4-b1d3-e3825dd1ccdd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:13.581286 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-25e7d6d7-752a-45c4-b1d3-e3825dd1ccdd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:13.581727 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-25e7d6d7-752a-45c4-b1d3-e3825dd1ccdd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:13.582465 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-25e7d6d7-752a-45c4-b1d3-e3825dd1ccdd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:13.582945 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-25e7d6d7-752a-45c4-b1d3-e3825dd1ccdd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:13.583373 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-25e7d6d7-752a-45c4-b1d3-e3825dd1ccdd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:13.610803 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-b2a88be4-a067-4617-ab86-6113f3fe340c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:13.611435 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-b2a88be4-a067-4617-ab86-6113f3fe340c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:13.617937 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b2a88be4-a067-4617-ab86-6113f3fe340c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:13.618415 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b2a88be4-a067-4617-ab86-6113f3fe340c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:13.618877 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b2a88be4-a067-4617-ab86-6113f3fe340c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:13.620324 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b2a88be4-a067-4617-ab86-6113f3fe340c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:13.624502 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b2a88be4-a067-4617-ab86-6113f3fe340c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:13.624502 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b2a88be4-a067-4617-ab86-6113f3fe340c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:13.701673 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-b2a88be4-a067-4617-ab86-6113f3fe340c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:13.703985 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell0:SELECT=8 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:13.710322 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-b2a88be4-a067-4617-ab86-6113f3fe340c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1243 microversion: 2.1 time: 0.103369 Aug 26 15:59:13.717580 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 187/381] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:13 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1243 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:59:13.739276 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-25e7d6d7-752a-45c4-b1d3-e3825dd1ccdd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:13.748465 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-25e7d6d7-752a-45c4-b1d3-e3825dd1ccdd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:13.752093 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-25e7d6d7-752a-45c4-b1d3-e3825dd1ccdd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:13.752093 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-25e7d6d7-752a-45c4-b1d3-e3825dd1ccdd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.185346 Aug 26 15:59:13.752093 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 195/382] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:13 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:14.730963 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-da1609ef-add0-4091-a535-546fb52d5351 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:14.731508 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-da1609ef-add0-4091-a535-546fb52d5351 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:14.738847 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-da1609ef-add0-4091-a535-546fb52d5351 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:14.739373 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-da1609ef-add0-4091-a535-546fb52d5351 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:14.739812 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-da1609ef-add0-4091-a535-546fb52d5351 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:14.740514 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-da1609ef-add0-4091-a535-546fb52d5351 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:14.740973 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-da1609ef-add0-4091-a535-546fb52d5351 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:14.741401 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-da1609ef-add0-4091-a535-546fb52d5351 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:14.778124 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-80331039-e7fe-480c-b4e2-225b431f3313 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:14.778994 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-80331039-e7fe-480c-b4e2-225b431f3313 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:14.785465 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-80331039-e7fe-480c-b4e2-225b431f3313 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:14.786035 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-80331039-e7fe-480c-b4e2-225b431f3313 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:14.786538 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-80331039-e7fe-480c-b4e2-225b431f3313 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:14.787343 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-80331039-e7fe-480c-b4e2-225b431f3313 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:14.787932 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-80331039-e7fe-480c-b4e2-225b431f3313 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:14.788444 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-80331039-e7fe-480c-b4e2-225b431f3313 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:14.805048 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-da1609ef-add0-4091-a535-546fb52d5351 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:14.812951 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-da1609ef-add0-4091-a535-546fb52d5351 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1235 microversion: 2.1 time: 0.086680 Aug 26 15:59:14.813538 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 188/383] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:14 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1235 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:14.928310 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-80331039-e7fe-480c-b4e2-225b431f3313 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:14.937479 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-80331039-e7fe-480c-b4e2-225b431f3313 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:14.939012 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-80331039-e7fe-480c-b4e2-225b431f3313 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:14.940308 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-80331039-e7fe-480c-b4e2-225b431f3313 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.166242 Aug 26 15:59:14.940871 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 196/384] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:14 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:59:15.844034 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-fb30a670-ffa8-42ce-8d65-f1c2c576d859 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:15.844677 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-fb30a670-ffa8-42ce-8d65-f1c2c576d859 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:15.851282 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fb30a670-ffa8-42ce-8d65-f1c2c576d859 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:15.851879 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fb30a670-ffa8-42ce-8d65-f1c2c576d859 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:15.852380 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fb30a670-ffa8-42ce-8d65-f1c2c576d859 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:15.853088 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fb30a670-ffa8-42ce-8d65-f1c2c576d859 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:15.853632 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fb30a670-ffa8-42ce-8d65-f1c2c576d859 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:15.854357 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fb30a670-ffa8-42ce-8d65-f1c2c576d859 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:15.920242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-fb30a670-ffa8-42ce-8d65-f1c2c576d859 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:15.928065 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-fb30a670-ffa8-42ce-8d65-f1c2c576d859 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1235 microversion: 2.1 time: 0.088042 Aug 26 15:59:15.928634 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 189/385] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:15 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1235 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:15.967103 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-903b1ba5-9260-4edb-b86c-52bbbf339f2c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:15.967706 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-903b1ba5-9260-4edb-b86c-52bbbf339f2c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:15.974713 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-903b1ba5-9260-4edb-b86c-52bbbf339f2c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:15.975320 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-903b1ba5-9260-4edb-b86c-52bbbf339f2c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:15.975756 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-903b1ba5-9260-4edb-b86c-52bbbf339f2c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:15.976433 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-903b1ba5-9260-4edb-b86c-52bbbf339f2c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:15.976876 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-903b1ba5-9260-4edb-b86c-52bbbf339f2c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:15.977292 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-903b1ba5-9260-4edb-b86c-52bbbf339f2c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:16.158280 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-903b1ba5-9260-4edb-b86c-52bbbf339f2c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:16.169077 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-903b1ba5-9260-4edb-b86c-52bbbf339f2c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:16.170625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-903b1ba5-9260-4edb-b86c-52bbbf339f2c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:16.171882 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-903b1ba5-9260-4edb-b86c-52bbbf339f2c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.210843 Aug 26 15:59:16.172441 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 197/386] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:15 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:16.730982 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ad674457-0607-4434-b5f9-6d64b386e31b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Action: 'create', calling method: .version_select at 0x7f15d96c3c10>, body: {"keypair": {"name": "tempest-keypair-1260259496", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkLutGt4DiP51ImR8g1MJ/DNmEYJwRohnJ/s5NS/JfqTE3U/e06etvTSqbX/wFqEGKuFY0j+4oOiLiBxCx8hsx4tcP26Cufkl5VnUWh0S0Qs5eUUz1e6gOllIlxWyxY/Q=="}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:59:16.750684 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-ad674457-0607-4434-b5f9-6d64b386e31b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Getting quotas for project 5f170813ecff47a68d7610de9d769287. Resources: {'key_pairs'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:59:16.756255 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-ad674457-0607-4434-b5f9-6d64b386e31b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Getting quotas for user 4940f8a9c15a483eab251df392789534 and project 5f170813ecff47a68d7610de9d769287. Resources: {'key_pairs'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:59:16.956290 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-5fa6deeb-40d4-4eb1-bc80-0229fe3641b2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:16.957194 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-5fa6deeb-40d4-4eb1-bc80-0229fe3641b2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:16.965580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5fa6deeb-40d4-4eb1-bc80-0229fe3641b2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:16.968718 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5fa6deeb-40d4-4eb1-bc80-0229fe3641b2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:16.969875 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5fa6deeb-40d4-4eb1-bc80-0229fe3641b2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:16.971773 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5fa6deeb-40d4-4eb1-bc80-0229fe3641b2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:16.972402 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5fa6deeb-40d4-4eb1-bc80-0229fe3641b2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:16.972992 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5fa6deeb-40d4-4eb1-bc80-0229fe3641b2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:16.983735 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ad674457-0607-4434-b5f9-6d64b386e31b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.256174 Aug 26 15:59:16.985876 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 190/387] 10.222.0.94 () {60 vars in 1159 bytes} [Fri Aug 26 15:59:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:59:17.090469 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-5fa6deeb-40d4-4eb1-bc80-0229fe3641b2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:17.101797 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-5fa6deeb-40d4-4eb1-bc80-0229fe3641b2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1235 microversion: 2.1 time: 0.150066 Aug 26 15:59:17.115099 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 198/388] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:16 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1235 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:17.207310 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7cd2f399-3999-422b-a0b6-e301d0b4f8d9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:17.208230 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-7cd2f399-3999-422b-a0b6-e301d0b4f8d9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:17.226115 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7cd2f399-3999-422b-a0b6-e301d0b4f8d9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:17.226776 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7cd2f399-3999-422b-a0b6-e301d0b4f8d9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:17.227097 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7cd2f399-3999-422b-a0b6-e301d0b4f8d9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:17.227819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7cd2f399-3999-422b-a0b6-e301d0b4f8d9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:17.235086 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7cd2f399-3999-422b-a0b6-e301d0b4f8d9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:17.235802 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7cd2f399-3999-422b-a0b6-e301d0b4f8d9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:17.264065 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=100 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:17.479128 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7cd2f399-3999-422b-a0b6-e301d0b4f8d9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:17.488861 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7cd2f399-3999-422b-a0b6-e301d0b4f8d9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:17.490310 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7cd2f399-3999-422b-a0b6-e301d0b4f8d9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:17.492879 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-7cd2f399-3999-422b-a0b6-e301d0b4f8d9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.296213 Aug 26 15:59:17.492879 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 191/389] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:17 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:59:17.820522 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-f8b3e23f-e3da-4d95-9f59-d13e53ebd9e2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "915ce1ba-294c-47ad-91ca-f4fbdaee069b", "device": "/dev/sdb"}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:59:17.826015 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-f8b3e23f-e3da-4d95-9f59-d13e53ebd9e2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 98316258-36ac-4e26-b92d-48fc237b5818] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:17.847179 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f8b3e23f-e3da-4d95-9f59-d13e53ebd9e2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:17.848143 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f8b3e23f-e3da-4d95-9f59-d13e53ebd9e2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:17.849692 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f8b3e23f-e3da-4d95-9f59-d13e53ebd9e2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:17.850781 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f8b3e23f-e3da-4d95-9f59-d13e53ebd9e2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:17.851520 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f8b3e23f-e3da-4d95-9f59-d13e53ebd9e2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:17.852181 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f8b3e23f-e3da-4d95-9f59-d13e53ebd9e2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:18.126177 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-d25f70dc-00f0-4d6a-8e71-ef48d39074de tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:18.127560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-d25f70dc-00f0-4d6a-8e71-ef48d39074de tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:18.136346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d25f70dc-00f0-4d6a-8e71-ef48d39074de tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:18.137175 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d25f70dc-00f0-4d6a-8e71-ef48d39074de tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:18.137820 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d25f70dc-00f0-4d6a-8e71-ef48d39074de tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:18.139528 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d25f70dc-00f0-4d6a-8e71-ef48d39074de tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:18.140002 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d25f70dc-00f0-4d6a-8e71-ef48d39074de tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:18.140618 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d25f70dc-00f0-4d6a-8e71-ef48d39074de tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:18.212362 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-d25f70dc-00f0-4d6a-8e71-ef48d39074de tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:18.241596 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-d25f70dc-00f0-4d6a-8e71-ef48d39074de tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1235 microversion: 2.1 time: 0.115942 Aug 26 15:59:18.249063 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 192/390] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:18 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1235 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:18.530387 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-d6dedd42-d185-4702-95fc-fa544eb83fbc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:18.531505 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-d6dedd42-d185-4702-95fc-fa544eb83fbc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:18.569811 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d6dedd42-d185-4702-95fc-fa544eb83fbc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:18.570585 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d6dedd42-d185-4702-95fc-fa544eb83fbc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:18.571250 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d6dedd42-d185-4702-95fc-fa544eb83fbc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:18.574503 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d6dedd42-d185-4702-95fc-fa544eb83fbc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:18.575535 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d6dedd42-d185-4702-95fc-fa544eb83fbc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:18.579248 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d6dedd42-d185-4702-95fc-fa544eb83fbc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:18.807141 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-d6dedd42-d185-4702-95fc-fa544eb83fbc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:18.816644 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-d6dedd42-d185-4702-95fc-fa544eb83fbc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:18.828318 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-d6dedd42-d185-4702-95fc-fa544eb83fbc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:18.832056 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-d6dedd42-d185-4702-95fc-fa544eb83fbc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.309478 Aug 26 15:59:18.832656 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 193/391] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:18 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:19.265105 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ebedba84-54bb-4986-90b9-686df7d65cf2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:19.265714 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ebedba84-54bb-4986-90b9-686df7d65cf2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:19.272064 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebedba84-54bb-4986-90b9-686df7d65cf2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:19.272539 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebedba84-54bb-4986-90b9-686df7d65cf2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:19.272967 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebedba84-54bb-4986-90b9-686df7d65cf2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:19.273660 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebedba84-54bb-4986-90b9-686df7d65cf2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:19.274106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebedba84-54bb-4986-90b9-686df7d65cf2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:19.274527 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebedba84-54bb-4986-90b9-686df7d65cf2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:19.347765 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-ebedba84-54bb-4986-90b9-686df7d65cf2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:19.356093 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ebedba84-54bb-4986-90b9-686df7d65cf2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1235 microversion: 2.1 time: 0.095402 Aug 26 15:59:19.375786 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 194/392] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:19 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1235 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:19.861439 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-6ed9dd4a-a94b-462e-941f-df64264a139f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:19.862467 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-6ed9dd4a-a94b-462e-941f-df64264a139f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:19.879154 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ed9dd4a-a94b-462e-941f-df64264a139f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:19.881283 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ed9dd4a-a94b-462e-941f-df64264a139f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:19.882720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ed9dd4a-a94b-462e-941f-df64264a139f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:19.888108 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ed9dd4a-a94b-462e-941f-df64264a139f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:19.893775 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ed9dd4a-a94b-462e-941f-df64264a139f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:19.894423 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ed9dd4a-a94b-462e-941f-df64264a139f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:20.196182 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-6ed9dd4a-a94b-462e-941f-df64264a139f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:20.211514 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-6ed9dd4a-a94b-462e-941f-df64264a139f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:20.220358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-6ed9dd4a-a94b-462e-941f-df64264a139f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:20.221824 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-6ed9dd4a-a94b-462e-941f-df64264a139f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.364583 Aug 26 15:59:20.224623 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 195/393] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:19 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:59:20.392929 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-56887921-0732-420f-8b62-a46d65998cbc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:20.393658 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-56887921-0732-420f-8b62-a46d65998cbc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:20.423268 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-56887921-0732-420f-8b62-a46d65998cbc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:20.424426 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-56887921-0732-420f-8b62-a46d65998cbc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:20.425111 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-56887921-0732-420f-8b62-a46d65998cbc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:20.426244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-56887921-0732-420f-8b62-a46d65998cbc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:20.426716 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-56887921-0732-420f-8b62-a46d65998cbc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:20.427203 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-56887921-0732-420f-8b62-a46d65998cbc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:20.520678 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-56887921-0732-420f-8b62-a46d65998cbc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:20.531189 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-56887921-0732-420f-8b62-a46d65998cbc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1235 microversion: 2.1 time: 0.151415 Aug 26 15:59:20.541518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 196/394] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:20 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1235 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:21.241717 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-fcddd5a0-3fa4-4755-9528-783f22981d19 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-466597220", "imageRef": "bcbdbb0c-7335-4427-a636-e2dc730274b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3e12d9a-1559-439b-ab2a-deef2d81938d"}], "security_groups": [{"name": "tempest-securitygroup--1200723654"}], "key_name": "tempest-keypair-1260259496", "user_data": "}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:59:21.396555 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.network.neutron [None req-fcddd5a0-3fa4-4755-9528-783f22981d19 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] validate_networks() for [('a3e12d9a-1559-439b-ab2a-deef2d81938d', None, None, None, None, None)] {{(pid=128304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:59:21.505878 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-f8b3e23f-e3da-4d95-9f59-d13e53ebd9e2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "POST /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.689306 Aug 26 15:59:21.510178 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 199/395] 10.222.0.94 () {60 vars in 1323 bytes} [Fri Aug 26 15:59:17 2022] POST /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818/os-volume_attachments => generated 194 bytes in 3694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:59:21.516786 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-b8d16856-c809-4260-94cc-90a48691e6a8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:21.517753 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-b8d16856-c809-4260-94cc-90a48691e6a8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:21.536136 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b8d16856-c809-4260-94cc-90a48691e6a8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:21.537018 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b8d16856-c809-4260-94cc-90a48691e6a8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:21.537751 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b8d16856-c809-4260-94cc-90a48691e6a8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:21.538620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b8d16856-c809-4260-94cc-90a48691e6a8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:21.539268 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b8d16856-c809-4260-94cc-90a48691e6a8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:21.539884 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b8d16856-c809-4260-94cc-90a48691e6a8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:21.982010 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b8d16856-c809-4260-94cc-90a48691e6a8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:21.997503 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b8d16856-c809-4260-94cc-90a48691e6a8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:22.005657 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b8d16856-c809-4260-94cc-90a48691e6a8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:22.005657 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-b8d16856-c809-4260-94cc-90a48691e6a8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1746 microversion: 2.20 time: 0.490033 Aug 26 15:59:22.005657 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 200/396] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:21 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1746 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:22.010140 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-3dd2708d-0bc8-4658-a2c1-96845b0fedd5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:22.010981 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-3dd2708d-0bc8-4658-a2c1-96845b0fedd5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:22.018791 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3dd2708d-0bc8-4658-a2c1-96845b0fedd5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:22.019319 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3dd2708d-0bc8-4658-a2c1-96845b0fedd5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:22.020122 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3dd2708d-0bc8-4658-a2c1-96845b0fedd5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:22.020986 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3dd2708d-0bc8-4658-a2c1-96845b0fedd5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:22.021617 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3dd2708d-0bc8-4658-a2c1-96845b0fedd5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:22.022264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3dd2708d-0bc8-4658-a2c1-96845b0fedd5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:22.203436 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-3dd2708d-0bc8-4658-a2c1-96845b0fedd5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:22.228939 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-3dd2708d-0bc8-4658-a2c1-96845b0fedd5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1299 microversion: 2.1 time: 0.223743 Aug 26 15:59:22.229833 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 201/397] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:22 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1299 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:22.247581 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-98c9eedc-a4fb-4764-8435-55590f493ffa tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:59:22.276949 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-98c9eedc-a4fb-4764-8435-55590f493ffa tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:22.277703 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-98c9eedc-a4fb-4764-8435-55590f493ffa tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:22.278353 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-98c9eedc-a4fb-4764-8435-55590f493ffa tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:22.454982 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-98c9eedc-a4fb-4764-8435-55590f493ffa tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Going to try to stop instance {{(pid=128305) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 26 15:59:22.502477 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-fcddd5a0-3fa4-4755-9528-783f22981d19 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Flavor limits 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:59:22.505440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-fcddd5a0-3fa4-4755-9528-783f22981d19 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Image limits 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:59:22.505440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-fcddd5a0-3fa4-4755-9528-783f22981d19 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Flavor pref 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:59:22.505440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-fcddd5a0-3fa4-4755-9528-783f22981d19 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Image pref 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:59:22.505440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-fcddd5a0-3fa4-4755-9528-783f22981d19 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:59:22.530772 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fcddd5a0-3fa4-4755-9528-783f22981d19 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:22.533172 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fcddd5a0-3fa4-4755-9528-783f22981d19 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:22.533805 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fcddd5a0-3fa4-4755-9528-783f22981d19 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:22.539033 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fcddd5a0-3fa4-4755-9528-783f22981d19 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:22.539967 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fcddd5a0-3fa4-4755-9528-783f22981d19 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:22.540654 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fcddd5a0-3fa4-4755-9528-783f22981d19 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:22.589087 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-fcddd5a0-3fa4-4755-9528-783f22981d19 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Getting quotas for project 5f170813ecff47a68d7610de9d769287. Resources: {'instances', 'ram', 'cores'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:59:22.604518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-fcddd5a0-3fa4-4755-9528-783f22981d19 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Getting quotas for user 4940f8a9c15a483eab251df392789534 and project 5f170813ecff47a68d7610de9d769287. Resources: {'instances', 'ram', 'cores'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:59:22.633181 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-fcddd5a0-3fa4-4755-9528-783f22981d19 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Going to run 1 instances... {{(pid=128304) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:59:22.637015 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-fcddd5a0-3fa4-4755-9528-783f22981d19 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bcbdbb0c-7335-4427-a636-e2dc730274b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:59:22.764878 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-98c9eedc-a4fb-4764-8435-55590f493ffa tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "POST /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e/action" status: 202 len: 0 microversion: 2.1 time: 0.533492 Aug 26 15:59:22.765479 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 202/398] 10.222.0.94 () {60 vars in 1278 bytes} [Fri Aug 26 15:59:22 2022] POST /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e/action => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:59:22.780728 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-81d582ed-f699-42a7-92d2-b0f689addbf7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:22.781548 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-81d582ed-f699-42a7-92d2-b0f689addbf7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:22.803516 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-81d582ed-f699-42a7-92d2-b0f689addbf7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:22.804017 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-81d582ed-f699-42a7-92d2-b0f689addbf7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:22.804456 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-81d582ed-f699-42a7-92d2-b0f689addbf7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:22.805174 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-81d582ed-f699-42a7-92d2-b0f689addbf7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:22.806826 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-81d582ed-f699-42a7-92d2-b0f689addbf7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:22.809042 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-81d582ed-f699-42a7-92d2-b0f689addbf7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:22.925937 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-fcddd5a0-3fa4-4755-9528-783f22981d19 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.687401 Aug 26 15:59:22.930398 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 197/399] 10.222.0.94 () {60 vars in 1147 bytes} [Fri Aug 26 15:59:21 2022] POST /compute/v2.1/servers => generated 409 bytes in 1692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 15:59:22.951427 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-9fd573a5-b550-4620-aaca-d51c99104fa9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:22.953171 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-9fd573a5-b550-4620-aaca-d51c99104fa9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:23.092623 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-9fd573a5-b550-4620-aaca-d51c99104fa9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:23.117530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-9fd573a5-b550-4620-aaca-d51c99104fa9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1245 microversion: 2.1 time: 0.175486 Aug 26 15:59:23.131716 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 198/400] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:22 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1245 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:23.141498 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-15d9da49-01fc-43f4-a662-75625e60ad32 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:23.142840 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-15d9da49-01fc-43f4-a662-75625e60ad32 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:23.151530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-15d9da49-01fc-43f4-a662-75625e60ad32 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:23.153266 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-15d9da49-01fc-43f4-a662-75625e60ad32 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:23.153920 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-15d9da49-01fc-43f4-a662-75625e60ad32 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:23.155206 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-15d9da49-01fc-43f4-a662-75625e60ad32 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:23.156639 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-15d9da49-01fc-43f4-a662-75625e60ad32 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:23.157740 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-15d9da49-01fc-43f4-a662-75625e60ad32 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:23.328211 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-81d582ed-f699-42a7-92d2-b0f689addbf7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:23.347784 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-81d582ed-f699-42a7-92d2-b0f689addbf7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1724 microversion: 2.1 time: 0.573730 Aug 26 15:59:23.349709 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 203/401] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:22 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1724 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:23.358902 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-18a5b1ec-9415-4a9b-a9ae-32d207882447 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:23.362029 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-18a5b1ec-9415-4a9b-a9ae-32d207882447 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:23.382805 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-18a5b1ec-9415-4a9b-a9ae-32d207882447 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:23.383584 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-18a5b1ec-9415-4a9b-a9ae-32d207882447 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:23.384206 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-18a5b1ec-9415-4a9b-a9ae-32d207882447 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:23.385154 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-18a5b1ec-9415-4a9b-a9ae-32d207882447 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:23.385807 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-18a5b1ec-9415-4a9b-a9ae-32d207882447 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:23.386410 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-18a5b1ec-9415-4a9b-a9ae-32d207882447 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:23.549389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-18a5b1ec-9415-4a9b-a9ae-32d207882447 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:23.554771 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-15d9da49-01fc-43f4-a662-75625e60ad32 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:23.563020 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-15d9da49-01fc-43f4-a662-75625e60ad32 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:23.564361 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-18a5b1ec-9415-4a9b-a9ae-32d207882447 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1297 microversion: 2.1 time: 0.213025 Aug 26 15:59:23.565433 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 204/402] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:23 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1297 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:23.583049 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-15d9da49-01fc-43f4-a662-75625e60ad32 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:23.586773 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-15d9da49-01fc-43f4-a662-75625e60ad32 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1746 microversion: 2.20 time: 0.456628 Aug 26 15:59:23.591301 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 199/403] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:23 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1746 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:24.034448 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-a3235a7a-6321-4ce6-9ccd-eb39b884ecf5 req-af4ab46d-9956-4e14-ae00-6dd63693e490 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac977a7-aa08-459a-a863-36ba667422d1", "name": "network-vif-plugged", "status": "completed", "tag": "8a53b00a-319e-4368-a0b0-216d2f508b1d"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:59:24.050256 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-a3235a7a-6321-4ce6-9ccd-eb39b884ecf5 req-af4ab46d-9956-4e14-ae00-6dd63693e490 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:24.051171 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-a3235a7a-6321-4ce6-9ccd-eb39b884ecf5 req-af4ab46d-9956-4e14-ae00-6dd63693e490 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:24.051875 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-a3235a7a-6321-4ce6-9ccd-eb39b884ecf5 req-af4ab46d-9956-4e14-ae00-6dd63693e490 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:24.068245 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-a3235a7a-6321-4ce6-9ccd-eb39b884ecf5 req-af4ab46d-9956-4e14-ae00-6dd63693e490 service nova] Creating event network-vif-plugged:8a53b00a-319e-4368-a0b0-216d2f508b1d for instance 8ac977a7-aa08-459a-a863-36ba667422d1 on hv-cinder-85144 Aug 26 15:59:24.079988 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-a3235a7a-6321-4ce6-9ccd-eb39b884ecf5 req-af4ab46d-9956-4e14-ae00-6dd63693e490 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049226 Aug 26 15:59:24.081379 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 205/404] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 15:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:59:24.146094 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-e2227271-fb59-4254-8802-a837a1b85f73 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:24.147104 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-e2227271-fb59-4254-8802-a837a1b85f73 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:24.156904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:24.229435 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e2227271-fb59-4254-8802-a837a1b85f73 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:24.240784 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-e2227271-fb59-4254-8802-a837a1b85f73 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1245 microversion: 2.1 time: 0.098559 Aug 26 15:59:24.242060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 200/405] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:24 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1245 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:24.377304 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-38fb7fce-b1e7-4e89-9f96-46f8f2396ea9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:24.378627 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-38fb7fce-b1e7-4e89-9f96-46f8f2396ea9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:24.397481 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-38fb7fce-b1e7-4e89-9f96-46f8f2396ea9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:24.403927 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-38fb7fce-b1e7-4e89-9f96-46f8f2396ea9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:24.404362 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-38fb7fce-b1e7-4e89-9f96-46f8f2396ea9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:24.407397 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-38fb7fce-b1e7-4e89-9f96-46f8f2396ea9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:24.408882 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-38fb7fce-b1e7-4e89-9f96-46f8f2396ea9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:24.409785 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-38fb7fce-b1e7-4e89-9f96-46f8f2396ea9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:24.597435 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-c8dc39b5-101e-45f0-88d1-21d880bc9fcd tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:24.598280 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-c8dc39b5-101e-45f0-88d1-21d880bc9fcd tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:24.627480 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c8dc39b5-101e-45f0-88d1-21d880bc9fcd tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:24.629755 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c8dc39b5-101e-45f0-88d1-21d880bc9fcd tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:24.630841 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c8dc39b5-101e-45f0-88d1-21d880bc9fcd tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:24.632598 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c8dc39b5-101e-45f0-88d1-21d880bc9fcd tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:24.633507 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c8dc39b5-101e-45f0-88d1-21d880bc9fcd tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:24.637295 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c8dc39b5-101e-45f0-88d1-21d880bc9fcd tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:24.985131 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-38fb7fce-b1e7-4e89-9f96-46f8f2396ea9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:24.988061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-38fb7fce-b1e7-4e89-9f96-46f8f2396ea9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1724 microversion: 2.1 time: 0.618420 Aug 26 15:59:24.991376 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 206/406] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:24 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1724 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:25.028745 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-929e8c72-cd79-49e6-a8f8-0a2f0691f16f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:25.028745 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-929e8c72-cd79-49e6-a8f8-0a2f0691f16f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:25.032901 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-929e8c72-cd79-49e6-a8f8-0a2f0691f16f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:25.033322 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-929e8c72-cd79-49e6-a8f8-0a2f0691f16f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:25.033753 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-929e8c72-cd79-49e6-a8f8-0a2f0691f16f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:25.035008 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-929e8c72-cd79-49e6-a8f8-0a2f0691f16f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:25.036472 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-929e8c72-cd79-49e6-a8f8-0a2f0691f16f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:25.037261 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-929e8c72-cd79-49e6-a8f8-0a2f0691f16f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:25.042847 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:25.165654 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-c8dc39b5-101e-45f0-88d1-21d880bc9fcd tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:25.179642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-c8dc39b5-101e-45f0-88d1-21d880bc9fcd tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1365 microversion: 2.1 time: 0.590454 Aug 26 15:59:25.184164 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 201/407] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:24 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1365 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:25.274570 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-8da27528-4f55-4d51-a282-ffe785b223e8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:25.279460 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-8da27528-4f55-4d51-a282-ffe785b223e8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:25.300563 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8da27528-4f55-4d51-a282-ffe785b223e8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:25.301067 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8da27528-4f55-4d51-a282-ffe785b223e8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:25.301513 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8da27528-4f55-4d51-a282-ffe785b223e8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:25.302236 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8da27528-4f55-4d51-a282-ffe785b223e8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:25.302682 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8da27528-4f55-4d51-a282-ffe785b223e8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:25.303577 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-929e8c72-cd79-49e6-a8f8-0a2f0691f16f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:25.307224 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8da27528-4f55-4d51-a282-ffe785b223e8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:25.314734 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-929e8c72-cd79-49e6-a8f8-0a2f0691f16f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:25.317230 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-929e8c72-cd79-49e6-a8f8-0a2f0691f16f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:25.327260 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-929e8c72-cd79-49e6-a8f8-0a2f0691f16f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1741 microversion: 2.20 time: 0.324046 Aug 26 15:59:25.327260 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 207/408] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:24 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1741 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:25.420701 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-8da27528-4f55-4d51-a282-ffe785b223e8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:25.429977 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-8da27528-4f55-4d51-a282-ffe785b223e8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1249 microversion: 2.1 time: 0.162268 Aug 26 15:59:25.446769 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 202/409] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:25 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1249 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:26.020665 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-b994f1e5-6fa4-4981-b900-74bb76e67ee5 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:26.021483 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-b994f1e5-6fa4-4981-b900-74bb76e67ee5 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:26.032504 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-82af74cb-3191-4f6c-9f2a-89f2d7c6e3c4 req-0787072a-1689-4291-961e-7dc5439184f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae11b5f9-e68f-4300-82b2-65e2acc9b282", "tag": "28a6367d-771f-4b85-b73b-d4f7949eaa49"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:59:26.073254 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b994f1e5-6fa4-4981-b900-74bb76e67ee5 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:26.074908 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b994f1e5-6fa4-4981-b900-74bb76e67ee5 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:26.075580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b994f1e5-6fa4-4981-b900-74bb76e67ee5 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:26.077194 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b994f1e5-6fa4-4981-b900-74bb76e67ee5 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:26.077664 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b994f1e5-6fa4-4981-b900-74bb76e67ee5 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:26.078103 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b994f1e5-6fa4-4981-b900-74bb76e67ee5 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:26.090536 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-82af74cb-3191-4f6c-9f2a-89f2d7c6e3c4 req-0787072a-1689-4291-961e-7dc5439184f7 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:26.095184 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-82af74cb-3191-4f6c-9f2a-89f2d7c6e3c4 req-0787072a-1689-4291-961e-7dc5439184f7 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:26.098990 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-82af74cb-3191-4f6c-9f2a-89f2d7c6e3c4 req-0787072a-1689-4291-961e-7dc5439184f7 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:26.128837 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-82af74cb-3191-4f6c-9f2a-89f2d7c6e3c4 req-0787072a-1689-4291-961e-7dc5439184f7 service nova] Creating event network-changed:28a6367d-771f-4b85-b73b-d4f7949eaa49 for instance ae11b5f9-e68f-4300-82b2-65e2acc9b282 on hv-cinder-85144 Aug 26 15:59:26.146091 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-82af74cb-3191-4f6c-9f2a-89f2d7c6e3c4 req-0787072a-1689-4291-961e-7dc5439184f7 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106942 Aug 26 15:59:26.146091 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 203/410] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 15:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:59:26.227303 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-9040d228-48d5-4188-a425-53fc7723a461 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:26.230737 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-9040d228-48d5-4188-a425-53fc7723a461 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:26.255301 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9040d228-48d5-4188-a425-53fc7723a461 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:26.257748 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9040d228-48d5-4188-a425-53fc7723a461 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:26.258513 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9040d228-48d5-4188-a425-53fc7723a461 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:26.261213 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9040d228-48d5-4188-a425-53fc7723a461 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:26.261928 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9040d228-48d5-4188-a425-53fc7723a461 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:26.262621 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9040d228-48d5-4188-a425-53fc7723a461 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:26.530509 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b994f1e5-6fa4-4981-b900-74bb76e67ee5 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:26.548524 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-b994f1e5-6fa4-4981-b900-74bb76e67ee5 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1724 microversion: 2.1 time: 0.532597 Aug 26 15:59:26.573799 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 208/411] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:26 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1724 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:26.596153 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-2ce916a5-b7c1-46f9-a838-11b22b11b908 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:26.598391 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-2ce916a5-b7c1-46f9-a838-11b22b11b908 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:26.615107 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2ce916a5-b7c1-46f9-a838-11b22b11b908 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:26.617573 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2ce916a5-b7c1-46f9-a838-11b22b11b908 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:26.619454 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2ce916a5-b7c1-46f9-a838-11b22b11b908 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:26.626217 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2ce916a5-b7c1-46f9-a838-11b22b11b908 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:26.626988 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2ce916a5-b7c1-46f9-a838-11b22b11b908 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:26.627705 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2ce916a5-b7c1-46f9-a838-11b22b11b908 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:26.658488 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-9040d228-48d5-4188-a425-53fc7723a461 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:26.670100 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-9040d228-48d5-4188-a425-53fc7723a461 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1365 microversion: 2.1 time: 0.463503 Aug 26 15:59:26.675059 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 204/412] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:26 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1365 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:59:26.694749 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-52c3b9bb-5d5c-4150-a773-02fdf7bfbcf1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:26.694749 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-52c3b9bb-5d5c-4150-a773-02fdf7bfbcf1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:26.727291 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-52c3b9bb-5d5c-4150-a773-02fdf7bfbcf1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:26.733960 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-52c3b9bb-5d5c-4150-a773-02fdf7bfbcf1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:26.735297 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-52c3b9bb-5d5c-4150-a773-02fdf7bfbcf1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:26.737340 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-52c3b9bb-5d5c-4150-a773-02fdf7bfbcf1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:26.741249 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-52c3b9bb-5d5c-4150-a773-02fdf7bfbcf1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:26.743580 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-52c3b9bb-5d5c-4150-a773-02fdf7bfbcf1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:26.893891 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-52c3b9bb-5d5c-4150-a773-02fdf7bfbcf1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:26.914402 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-52c3b9bb-5d5c-4150-a773-02fdf7bfbcf1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1297 microversion: 2.1 time: 0.237601 Aug 26 15:59:26.932065 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 205/413] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:26 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1297 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:27.062879 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-2ce916a5-b7c1-46f9-a838-11b22b11b908 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:27.082723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-2ce916a5-b7c1-46f9-a838-11b22b11b908 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:27.087753 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-2ce916a5-b7c1-46f9-a838-11b22b11b908 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:27.088999 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-2ce916a5-b7c1-46f9-a838-11b22b11b908 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1741 microversion: 2.20 time: 0.510633 Aug 26 15:59:27.103178 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 209/414] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:26 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1741 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:27.588763 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-d5369c5f-8cee-4590-8674-7550994407b9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:27.589361 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-d5369c5f-8cee-4590-8674-7550994407b9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:27.612915 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d5369c5f-8cee-4590-8674-7550994407b9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:27.616212 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d5369c5f-8cee-4590-8674-7550994407b9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:27.616859 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d5369c5f-8cee-4590-8674-7550994407b9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:27.621597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d5369c5f-8cee-4590-8674-7550994407b9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:27.622593 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d5369c5f-8cee-4590-8674-7550994407b9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:27.624378 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d5369c5f-8cee-4590-8674-7550994407b9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:27.696676 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-dcf7d63d-5e3a-418c-9ba5-b905309e570c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:27.697669 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-dcf7d63d-5e3a-418c-9ba5-b905309e570c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:27.711438 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dcf7d63d-5e3a-418c-9ba5-b905309e570c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:27.712990 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dcf7d63d-5e3a-418c-9ba5-b905309e570c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:27.714956 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dcf7d63d-5e3a-418c-9ba5-b905309e570c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:27.716778 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dcf7d63d-5e3a-418c-9ba5-b905309e570c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:27.719129 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dcf7d63d-5e3a-418c-9ba5-b905309e570c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:27.720052 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dcf7d63d-5e3a-418c-9ba5-b905309e570c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:28.204170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-d5369c5f-8cee-4590-8674-7550994407b9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:28.218054 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-d5369c5f-8cee-4590-8674-7550994407b9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1724 microversion: 2.1 time: 0.635617 Aug 26 15:59:28.221874 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 206/415] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:27 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1724 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:28.228097 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-71a80afe-764b-4a0f-be1e-019349e8bf89 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:28.237854 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-71a80afe-764b-4a0f-be1e-019349e8bf89 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:28.253343 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-dcf7d63d-5e3a-418c-9ba5-b905309e570c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:28.265584 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-71a80afe-764b-4a0f-be1e-019349e8bf89 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:28.267114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-71a80afe-764b-4a0f-be1e-019349e8bf89 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:28.268251 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-71a80afe-764b-4a0f-be1e-019349e8bf89 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:28.268625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-dcf7d63d-5e3a-418c-9ba5-b905309e570c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1365 microversion: 2.1 time: 0.573220 Aug 26 15:59:28.284176 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-71a80afe-764b-4a0f-be1e-019349e8bf89 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:28.284852 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 210/416] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:27 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1365 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:59:28.286879 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-71a80afe-764b-4a0f-be1e-019349e8bf89 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:28.287627 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-71a80afe-764b-4a0f-be1e-019349e8bf89 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:28.301139 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-7b33a241-ec93-4734-b4e2-7f144c24bb14 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:28.304240 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-7b33a241-ec93-4734-b4e2-7f144c24bb14 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:28.317778 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7b33a241-ec93-4734-b4e2-7f144c24bb14 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:28.325070 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7b33a241-ec93-4734-b4e2-7f144c24bb14 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:28.325841 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7b33a241-ec93-4734-b4e2-7f144c24bb14 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:28.327245 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7b33a241-ec93-4734-b4e2-7f144c24bb14 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:28.328088 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7b33a241-ec93-4734-b4e2-7f144c24bb14 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:28.328766 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7b33a241-ec93-4734-b4e2-7f144c24bb14 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:28.438521 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-71a80afe-764b-4a0f-be1e-019349e8bf89 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:28.460590 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-71a80afe-764b-4a0f-be1e-019349e8bf89 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1303 microversion: 2.1 time: 0.234644 Aug 26 15:59:28.465186 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 207/417] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:28 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1303 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:28.752996 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-7b33a241-ec93-4734-b4e2-7f144c24bb14 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:28.770291 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-7b33a241-ec93-4734-b4e2-7f144c24bb14 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:28.771957 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-7b33a241-ec93-4734-b4e2-7f144c24bb14 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:28.773232 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-7b33a241-ec93-4734-b4e2-7f144c24bb14 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1741 microversion: 2.20 time: 0.487105 Aug 26 15:59:28.773809 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 211/418] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:28 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1741 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:29.262158 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-a71a376a-7195-4445-a0f2-e32fa32b1211 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:29.263805 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-a71a376a-7195-4445-a0f2-e32fa32b1211 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:29.281779 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a71a376a-7195-4445-a0f2-e32fa32b1211 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:29.282864 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a71a376a-7195-4445-a0f2-e32fa32b1211 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:29.283739 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a71a376a-7195-4445-a0f2-e32fa32b1211 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:29.284961 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a71a376a-7195-4445-a0f2-e32fa32b1211 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:29.285615 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a71a376a-7195-4445-a0f2-e32fa32b1211 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:29.286220 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a71a376a-7195-4445-a0f2-e32fa32b1211 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:29.300552 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-26e14a26-38a3-4706-9dc6-51db87fc1320 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:29.304070 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-26e14a26-38a3-4706-9dc6-51db87fc1320 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:29.336046 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-26e14a26-38a3-4706-9dc6-51db87fc1320 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:29.339723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-26e14a26-38a3-4706-9dc6-51db87fc1320 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:29.342467 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-26e14a26-38a3-4706-9dc6-51db87fc1320 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:29.347289 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-26e14a26-38a3-4706-9dc6-51db87fc1320 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:29.348549 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-26e14a26-38a3-4706-9dc6-51db87fc1320 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:29.350253 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-26e14a26-38a3-4706-9dc6-51db87fc1320 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:29.803048 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-a71a376a-7195-4445-a0f2-e32fa32b1211 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:29.820082 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-a71a376a-7195-4445-a0f2-e32fa32b1211 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1724 microversion: 2.1 time: 0.574776 Aug 26 15:59:29.833870 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 208/419] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:29 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1724 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:59:29.833870 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-76ee6cfe-9e53-444f-83eb-2d1da66e7ba7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:29.835156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-76ee6cfe-9e53-444f-83eb-2d1da66e7ba7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:29.849276 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-76ee6cfe-9e53-444f-83eb-2d1da66e7ba7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:29.850079 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-76ee6cfe-9e53-444f-83eb-2d1da66e7ba7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:29.850655 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-76ee6cfe-9e53-444f-83eb-2d1da66e7ba7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:29.861298 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-76ee6cfe-9e53-444f-83eb-2d1da66e7ba7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:29.862178 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-76ee6cfe-9e53-444f-83eb-2d1da66e7ba7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:29.863135 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-76ee6cfe-9e53-444f-83eb-2d1da66e7ba7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:29.880630 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-26e14a26-38a3-4706-9dc6-51db87fc1320 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:29.893739 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-26e14a26-38a3-4706-9dc6-51db87fc1320 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1365 microversion: 2.1 time: 0.603730 Aug 26 15:59:29.906963 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 212/420] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:29 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1365 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:29.906963 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a11b42a1-cd1f-48e3-9d50-2b4117ec95ef tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:29.906963 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a11b42a1-cd1f-48e3-9d50-2b4117ec95ef tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:29.918904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a11b42a1-cd1f-48e3-9d50-2b4117ec95ef tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:29.918904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a11b42a1-cd1f-48e3-9d50-2b4117ec95ef tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:29.918904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a11b42a1-cd1f-48e3-9d50-2b4117ec95ef tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:29.918904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a11b42a1-cd1f-48e3-9d50-2b4117ec95ef tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:29.920520 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a11b42a1-cd1f-48e3-9d50-2b4117ec95ef tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:29.920520 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a11b42a1-cd1f-48e3-9d50-2b4117ec95ef tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:29.977447 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-76ee6cfe-9e53-444f-83eb-2d1da66e7ba7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:29.989659 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-76ee6cfe-9e53-444f-83eb-2d1da66e7ba7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1303 microversion: 2.1 time: 0.162897 Aug 26 15:59:29.992360 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 209/421] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:29 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1303 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:30.231478 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a11b42a1-cd1f-48e3-9d50-2b4117ec95ef tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:30.257679 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a11b42a1-cd1f-48e3-9d50-2b4117ec95ef tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:30.261505 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a11b42a1-cd1f-48e3-9d50-2b4117ec95ef tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:30.272031 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a11b42a1-cd1f-48e3-9d50-2b4117ec95ef tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1741 microversion: 2.20 time: 0.371815 Aug 26 15:59:30.273029 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 213/422] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:29 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1741 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:30.858273 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-d847f1c0-4b30-4fd8-9157-fec05a82a3ab tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:30.858967 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-d847f1c0-4b30-4fd8-9157-fec05a82a3ab tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:30.865388 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d847f1c0-4b30-4fd8-9157-fec05a82a3ab tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:30.865872 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d847f1c0-4b30-4fd8-9157-fec05a82a3ab tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:30.866315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d847f1c0-4b30-4fd8-9157-fec05a82a3ab tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:30.867043 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d847f1c0-4b30-4fd8-9157-fec05a82a3ab tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:30.867503 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d847f1c0-4b30-4fd8-9157-fec05a82a3ab tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:30.867931 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d847f1c0-4b30-4fd8-9157-fec05a82a3ab tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:30.926431 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-9115e8bb-d127-4ffd-9283-8389b7e3b93c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:30.928400 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-9115e8bb-d127-4ffd-9283-8389b7e3b93c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:30.936743 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9115e8bb-d127-4ffd-9283-8389b7e3b93c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:30.939442 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9115e8bb-d127-4ffd-9283-8389b7e3b93c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:30.940057 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9115e8bb-d127-4ffd-9283-8389b7e3b93c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:30.940951 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9115e8bb-d127-4ffd-9283-8389b7e3b93c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:30.941753 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9115e8bb-d127-4ffd-9283-8389b7e3b93c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:30.942345 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9115e8bb-d127-4ffd-9283-8389b7e3b93c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:31.203969 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-d847f1c0-4b30-4fd8-9157-fec05a82a3ab tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:31.216580 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-d847f1c0-4b30-4fd8-9157-fec05a82a3ab tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1724 microversion: 2.1 time: 0.362334 Aug 26 15:59:31.220065 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 210/423] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:30 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1724 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:31.228748 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-3cd178be-958f-425c-98c2-f320ca203f77 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:31.235643 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-3cd178be-958f-425c-98c2-f320ca203f77 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:31.246054 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3cd178be-958f-425c-98c2-f320ca203f77 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:31.246611 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3cd178be-958f-425c-98c2-f320ca203f77 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:31.251694 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3cd178be-958f-425c-98c2-f320ca203f77 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:31.252514 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3cd178be-958f-425c-98c2-f320ca203f77 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:31.252998 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3cd178be-958f-425c-98c2-f320ca203f77 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:31.253536 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3cd178be-958f-425c-98c2-f320ca203f77 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:31.264452 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=100 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:31.288871 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-9115e8bb-d127-4ffd-9283-8389b7e3b93c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:31.310649 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-9115e8bb-d127-4ffd-9283-8389b7e3b93c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1365 microversion: 2.1 time: 0.388356 Aug 26 15:59:31.314824 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 214/424] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:30 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1365 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:31.325781 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-9a8acae9-9df1-45d1-8f2f-3872ece347eb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:31.342326 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-9a8acae9-9df1-45d1-8f2f-3872ece347eb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:31.353045 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9a8acae9-9df1-45d1-8f2f-3872ece347eb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:31.354332 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9a8acae9-9df1-45d1-8f2f-3872ece347eb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:31.354967 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9a8acae9-9df1-45d1-8f2f-3872ece347eb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:31.355837 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9a8acae9-9df1-45d1-8f2f-3872ece347eb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:31.356482 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9a8acae9-9df1-45d1-8f2f-3872ece347eb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:31.357087 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9a8acae9-9df1-45d1-8f2f-3872ece347eb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:31.404824 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-3cd178be-958f-425c-98c2-f320ca203f77 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:31.418421 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-3cd178be-958f-425c-98c2-f320ca203f77 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1303 microversion: 2.1 time: 0.197040 Aug 26 15:59:31.431408 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 211/425] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:31 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1303 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:31.636450 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-9a8acae9-9df1-45d1-8f2f-3872ece347eb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:31.647645 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-9a8acae9-9df1-45d1-8f2f-3872ece347eb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:31.653902 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-9a8acae9-9df1-45d1-8f2f-3872ece347eb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:31.658776 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-9a8acae9-9df1-45d1-8f2f-3872ece347eb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1741 microversion: 2.20 time: 0.338491 Aug 26 15:59:31.658776 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 215/426] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:31 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1741 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:32.242627 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-0fb38c39-19a0-4511-b1ab-38c77d0c86f4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:32.244787 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-0fb38c39-19a0-4511-b1ab-38c77d0c86f4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:32.254521 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0fb38c39-19a0-4511-b1ab-38c77d0c86f4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:32.259309 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0fb38c39-19a0-4511-b1ab-38c77d0c86f4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:32.260121 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0fb38c39-19a0-4511-b1ab-38c77d0c86f4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:32.261113 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0fb38c39-19a0-4511-b1ab-38c77d0c86f4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:32.265441 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0fb38c39-19a0-4511-b1ab-38c77d0c86f4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:32.266268 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0fb38c39-19a0-4511-b1ab-38c77d0c86f4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:32.336116 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-b5bbe821-7b9e-4826-ae52-8727da550200 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:32.337544 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-b5bbe821-7b9e-4826-ae52-8727da550200 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:32.348432 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b5bbe821-7b9e-4826-ae52-8727da550200 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:32.362730 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b5bbe821-7b9e-4826-ae52-8727da550200 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:32.366140 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b5bbe821-7b9e-4826-ae52-8727da550200 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:32.370179 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b5bbe821-7b9e-4826-ae52-8727da550200 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:32.370685 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b5bbe821-7b9e-4826-ae52-8727da550200 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:32.373325 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b5bbe821-7b9e-4826-ae52-8727da550200 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:32.565509 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell0:SELECT=2 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:32.885247 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-0fb38c39-19a0-4511-b1ab-38c77d0c86f4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:32.907698 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-0fb38c39-19a0-4511-b1ab-38c77d0c86f4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1724 microversion: 2.1 time: 0.669641 Aug 26 15:59:32.913757 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 212/427] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:32 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1724 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:32.915349 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b5bbe821-7b9e-4826-ae52-8727da550200 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:32.926934 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-254745dc-db7a-434a-a2c5-ca1268cc243c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:32.927897 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-254745dc-db7a-434a-a2c5-ca1268cc243c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:32.928302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-b5bbe821-7b9e-4826-ae52-8727da550200 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1365 microversion: 2.1 time: 0.597443 Aug 26 15:59:32.936396 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 216/428] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:32 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1365 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:32.937820 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-254745dc-db7a-434a-a2c5-ca1268cc243c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:32.938431 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-254745dc-db7a-434a-a2c5-ca1268cc243c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:32.938863 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-254745dc-db7a-434a-a2c5-ca1268cc243c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:32.942504 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-b2fc592c-7dc9-496b-9f41-6279156e867c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:32.943365 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-b2fc592c-7dc9-496b-9f41-6279156e867c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:32.947791 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-254745dc-db7a-434a-a2c5-ca1268cc243c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:32.961260 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-254745dc-db7a-434a-a2c5-ca1268cc243c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:32.961260 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-254745dc-db7a-434a-a2c5-ca1268cc243c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:32.962099 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b2fc592c-7dc9-496b-9f41-6279156e867c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:32.962730 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b2fc592c-7dc9-496b-9f41-6279156e867c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:32.965569 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b2fc592c-7dc9-496b-9f41-6279156e867c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:32.966303 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b2fc592c-7dc9-496b-9f41-6279156e867c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:32.967168 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b2fc592c-7dc9-496b-9f41-6279156e867c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:32.967952 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b2fc592c-7dc9-496b-9f41-6279156e867c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:33.115691 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-254745dc-db7a-434a-a2c5-ca1268cc243c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:33.128779 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-254745dc-db7a-434a-a2c5-ca1268cc243c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1303 microversion: 2.1 time: 0.211794 Aug 26 15:59:33.133146 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 213/429] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:32 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1303 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:33.545680 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b2fc592c-7dc9-496b-9f41-6279156e867c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:33.563462 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b2fc592c-7dc9-496b-9f41-6279156e867c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:33.568613 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b2fc592c-7dc9-496b-9f41-6279156e867c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:33.576746 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-b2fc592c-7dc9-496b-9f41-6279156e867c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1741 microversion: 2.20 time: 0.638661 Aug 26 15:59:33.577637 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 217/430] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:32 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1741 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:33.943638 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-349a386d-e45e-4235-8450-6052634b76d9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:33.944330 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-349a386d-e45e-4235-8450-6052634b76d9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:33.965830 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-349a386d-e45e-4235-8450-6052634b76d9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:33.966277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a46e3799-701c-463b-a86a-96ec409871dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:33.966430 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-349a386d-e45e-4235-8450-6052634b76d9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:33.966741 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-349a386d-e45e-4235-8450-6052634b76d9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:33.967700 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a46e3799-701c-463b-a86a-96ec409871dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:33.967962 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-349a386d-e45e-4235-8450-6052634b76d9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:33.968408 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-349a386d-e45e-4235-8450-6052634b76d9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:33.968953 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-349a386d-e45e-4235-8450-6052634b76d9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:33.989536 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a46e3799-701c-463b-a86a-96ec409871dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:33.990056 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a46e3799-701c-463b-a86a-96ec409871dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:33.992559 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a46e3799-701c-463b-a86a-96ec409871dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:33.997128 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a46e3799-701c-463b-a86a-96ec409871dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:33.997721 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a46e3799-701c-463b-a86a-96ec409871dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:33.999794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a46e3799-701c-463b-a86a-96ec409871dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:34.233635 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell0:SELECT=14 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:34.430356 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-349a386d-e45e-4235-8450-6052634b76d9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:34.456403 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-349a386d-e45e-4235-8450-6052634b76d9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1724 microversion: 2.1 time: 0.518149 Aug 26 15:59:34.473582 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 214/431] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:33 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1724 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:34.485618 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-a38e5945-8517-41a6-8dc2-f4c3cc01a478 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:34.489113 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-a38e5945-8517-41a6-8dc2-f4c3cc01a478 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:34.504427 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a38e5945-8517-41a6-8dc2-f4c3cc01a478 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:34.505245 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a38e5945-8517-41a6-8dc2-f4c3cc01a478 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:34.510674 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a38e5945-8517-41a6-8dc2-f4c3cc01a478 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:34.511795 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a38e5945-8517-41a6-8dc2-f4c3cc01a478 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:34.512438 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a38e5945-8517-41a6-8dc2-f4c3cc01a478 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:34.513111 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a38e5945-8517-41a6-8dc2-f4c3cc01a478 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:34.587850 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a46e3799-701c-463b-a86a-96ec409871dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:34.606512 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a46e3799-701c-463b-a86a-96ec409871dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1365 microversion: 2.1 time: 0.645250 Aug 26 15:59:34.607891 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 218/432] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:33 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1365 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:59:34.619542 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-8e7151ee-90f5-458e-9b73-674828c4f660 req-eb1f9c1c-c4eb-403b-b975-7e6f642c0278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae11b5f9-e68f-4300-82b2-65e2acc9b282", "name": "network-vif-plugged", "status": "completed", "tag": "28a6367d-771f-4b85-b73b-d4f7949eaa49"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:59:34.644320 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-8e7151ee-90f5-458e-9b73-674828c4f660 req-eb1f9c1c-c4eb-403b-b975-7e6f642c0278 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:34.647704 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-8e7151ee-90f5-458e-9b73-674828c4f660 req-eb1f9c1c-c4eb-403b-b975-7e6f642c0278 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:34.648731 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-8e7151ee-90f5-458e-9b73-674828c4f660 req-eb1f9c1c-c4eb-403b-b975-7e6f642c0278 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:34.704847 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-8e7151ee-90f5-458e-9b73-674828c4f660 req-eb1f9c1c-c4eb-403b-b975-7e6f642c0278 service nova] Creating event network-vif-plugged:28a6367d-771f-4b85-b73b-d4f7949eaa49 for instance ae11b5f9-e68f-4300-82b2-65e2acc9b282 on hv-cinder-85144 Aug 26 15:59:34.721816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-8e7151ee-90f5-458e-9b73-674828c4f660 req-eb1f9c1c-c4eb-403b-b975-7e6f642c0278 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112084 Aug 26 15:59:34.727018 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 219/433] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 15:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:59:34.738212 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-9dba49fd-8892-428a-8a6b-18a184e5dc98 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:34.741927 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-9dba49fd-8892-428a-8a6b-18a184e5dc98 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:34.760610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9dba49fd-8892-428a-8a6b-18a184e5dc98 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:34.761871 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9dba49fd-8892-428a-8a6b-18a184e5dc98 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:34.763465 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9dba49fd-8892-428a-8a6b-18a184e5dc98 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:34.764457 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9dba49fd-8892-428a-8a6b-18a184e5dc98 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:34.767740 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9dba49fd-8892-428a-8a6b-18a184e5dc98 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:34.768407 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9dba49fd-8892-428a-8a6b-18a184e5dc98 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:34.893506 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-a38e5945-8517-41a6-8dc2-f4c3cc01a478 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:34.908405 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-a38e5945-8517-41a6-8dc2-f4c3cc01a478 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1303 microversion: 2.1 time: 0.432599 Aug 26 15:59:34.910224 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 215/434] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:34 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1303 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:35.129431 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-9dba49fd-8892-428a-8a6b-18a184e5dc98 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:35.144668 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-9dba49fd-8892-428a-8a6b-18a184e5dc98 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:35.148720 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-9dba49fd-8892-428a-8a6b-18a184e5dc98 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:35.149368 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-9dba49fd-8892-428a-8a6b-18a184e5dc98 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1741 microversion: 2.20 time: 0.420845 Aug 26 15:59:35.152864 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 220/435] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:34 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1741 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:35.485433 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-5da3e348-5678-414a-a7ed-2d3fadcca1ba tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:35.486140 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-5da3e348-5678-414a-a7ed-2d3fadcca1ba tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:35.497752 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5da3e348-5678-414a-a7ed-2d3fadcca1ba tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:35.498521 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5da3e348-5678-414a-a7ed-2d3fadcca1ba tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:35.499146 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5da3e348-5678-414a-a7ed-2d3fadcca1ba tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:35.500150 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5da3e348-5678-414a-a7ed-2d3fadcca1ba tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:35.500806 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5da3e348-5678-414a-a7ed-2d3fadcca1ba tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:35.501393 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5da3e348-5678-414a-a7ed-2d3fadcca1ba tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:35.629192 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-dc4f9454-aafe-4884-b397-5f6cd24d9f0a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:35.629932 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-dc4f9454-aafe-4884-b397-5f6cd24d9f0a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:35.639617 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dc4f9454-aafe-4884-b397-5f6cd24d9f0a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:35.647414 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dc4f9454-aafe-4884-b397-5f6cd24d9f0a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:35.660088 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dc4f9454-aafe-4884-b397-5f6cd24d9f0a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:35.715445 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dc4f9454-aafe-4884-b397-5f6cd24d9f0a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:35.715445 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dc4f9454-aafe-4884-b397-5f6cd24d9f0a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:35.715445 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dc4f9454-aafe-4884-b397-5f6cd24d9f0a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:36.000793 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-5da3e348-5678-414a-a7ed-2d3fadcca1ba tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:36.013589 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-5da3e348-5678-414a-a7ed-2d3fadcca1ba tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1724 microversion: 2.1 time: 0.532327 Aug 26 15:59:36.015505 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 216/436] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:35 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1724 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:36.017293 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-dc4f9454-aafe-4884-b397-5f6cd24d9f0a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:36.028557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-dc4f9454-aafe-4884-b397-5f6cd24d9f0a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1365 microversion: 2.1 time: 0.404768 Aug 26 15:59:36.029291 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 221/437] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:35 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1365 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:36.042969 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-c491f932-d3ea-4ad8-a7c2-5dbdf0c13b3b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:36.042969 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-c491f932-d3ea-4ad8-a7c2-5dbdf0c13b3b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:36.042969 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c491f932-d3ea-4ad8-a7c2-5dbdf0c13b3b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:36.042969 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c491f932-d3ea-4ad8-a7c2-5dbdf0c13b3b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:36.043534 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c491f932-d3ea-4ad8-a7c2-5dbdf0c13b3b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:36.043534 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c491f932-d3ea-4ad8-a7c2-5dbdf0c13b3b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:36.043534 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c491f932-d3ea-4ad8-a7c2-5dbdf0c13b3b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:36.043534 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c491f932-d3ea-4ad8-a7c2-5dbdf0c13b3b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:36.145754 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-c491f932-d3ea-4ad8-a7c2-5dbdf0c13b3b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:36.154018 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-c491f932-d3ea-4ad8-a7c2-5dbdf0c13b3b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1303 microversion: 2.1 time: 0.137660 Aug 26 15:59:36.154750 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 217/438] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:36 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1303 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:36.175740 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a2ad6b4a-a1c8-48b3-8e49-d8be58c6fd7e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:36.176497 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a2ad6b4a-a1c8-48b3-8e49-d8be58c6fd7e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:36.183755 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a2ad6b4a-a1c8-48b3-8e49-d8be58c6fd7e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:36.184337 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a2ad6b4a-a1c8-48b3-8e49-d8be58c6fd7e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:36.184774 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a2ad6b4a-a1c8-48b3-8e49-d8be58c6fd7e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:36.185478 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a2ad6b4a-a1c8-48b3-8e49-d8be58c6fd7e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:36.185929 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a2ad6b4a-a1c8-48b3-8e49-d8be58c6fd7e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:36.186352 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a2ad6b4a-a1c8-48b3-8e49-d8be58c6fd7e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:36.350381 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a2ad6b4a-a1c8-48b3-8e49-d8be58c6fd7e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:36.360123 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a2ad6b4a-a1c8-48b3-8e49-d8be58c6fd7e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:36.361566 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a2ad6b4a-a1c8-48b3-8e49-d8be58c6fd7e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:36.363307 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a2ad6b4a-a1c8-48b3-8e49-d8be58c6fd7e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1741 microversion: 2.20 time: 0.190910 Aug 26 15:59:36.368196 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 222/439] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:36 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1741 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:37.041577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-dc6a0575-9e23-4482-aa8b-dfa0d2dc2cad tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:37.042805 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-dc6a0575-9e23-4482-aa8b-dfa0d2dc2cad tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:37.058359 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-dc6a0575-9e23-4482-aa8b-dfa0d2dc2cad tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:37.060452 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-dc6a0575-9e23-4482-aa8b-dfa0d2dc2cad tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:37.062237 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-dc6a0575-9e23-4482-aa8b-dfa0d2dc2cad tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:37.063468 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-dc6a0575-9e23-4482-aa8b-dfa0d2dc2cad tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:37.065877 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-dc6a0575-9e23-4482-aa8b-dfa0d2dc2cad tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:37.071083 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-dc6a0575-9e23-4482-aa8b-dfa0d2dc2cad tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:37.079311 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-8192aae4-f881-4beb-add0-f853646071ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:37.083221 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-8192aae4-f881-4beb-add0-f853646071ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:37.094992 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_api:SELECT=68 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:37.101291 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8192aae4-f881-4beb-add0-f853646071ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:37.104283 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8192aae4-f881-4beb-add0-f853646071ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:37.106139 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8192aae4-f881-4beb-add0-f853646071ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:37.113506 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8192aae4-f881-4beb-add0-f853646071ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:37.114877 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8192aae4-f881-4beb-add0-f853646071ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:37.117435 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8192aae4-f881-4beb-add0-f853646071ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:37.791906 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-8192aae4-f881-4beb-add0-f853646071ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:37.804927 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-8192aae4-f881-4beb-add0-f853646071ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1365 microversion: 2.1 time: 0.746622 Aug 26 15:59:37.806567 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 223/440] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:37 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1365 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:37.816180 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-af8a7b97-5c89-48a7-a210-0237b811539f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:37.822469 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-af8a7b97-5c89-48a7-a210-0237b811539f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:37.842455 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-af8a7b97-5c89-48a7-a210-0237b811539f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:37.847503 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-af8a7b97-5c89-48a7-a210-0237b811539f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:37.847503 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-af8a7b97-5c89-48a7-a210-0237b811539f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:37.847503 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-af8a7b97-5c89-48a7-a210-0237b811539f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:37.847794 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-dc6a0575-9e23-4482-aa8b-dfa0d2dc2cad tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:37.847890 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-af8a7b97-5c89-48a7-a210-0237b811539f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:37.847890 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-af8a7b97-5c89-48a7-a210-0237b811539f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:37.858648 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-dc6a0575-9e23-4482-aa8b-dfa0d2dc2cad tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1724 microversion: 2.1 time: 0.822544 Aug 26 15:59:37.871154 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 218/441] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:37 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1724 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:37.881944 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-76d0cc1a-029f-4604-9df5-f697a7bdc6fe tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:37.883046 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-76d0cc1a-029f-4604-9df5-f697a7bdc6fe tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:37.915063 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-76d0cc1a-029f-4604-9df5-f697a7bdc6fe tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:37.915615 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-76d0cc1a-029f-4604-9df5-f697a7bdc6fe tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:37.916057 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-76d0cc1a-029f-4604-9df5-f697a7bdc6fe tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:37.923616 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-76d0cc1a-029f-4604-9df5-f697a7bdc6fe tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:37.924121 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-76d0cc1a-029f-4604-9df5-f697a7bdc6fe tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:37.924566 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-76d0cc1a-029f-4604-9df5-f697a7bdc6fe tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:37.927005 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=100 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:38.552396 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-af8a7b97-5c89-48a7-a210-0237b811539f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:38.572193 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-af8a7b97-5c89-48a7-a210-0237b811539f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1371 microversion: 2.1 time: 0.762374 Aug 26 15:59:38.592057 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 224/442] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:37 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1371 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:38.779789 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-76d0cc1a-029f-4604-9df5-f697a7bdc6fe tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:38.809263 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-76d0cc1a-029f-4604-9df5-f697a7bdc6fe tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:38.813998 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-76d0cc1a-029f-4604-9df5-f697a7bdc6fe tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:38.817737 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-76d0cc1a-029f-4604-9df5-f697a7bdc6fe tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1741 microversion: 2.20 time: 0.955792 Aug 26 15:59:38.820563 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 219/443] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:37 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1741 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:38.828519 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-b66bbdea-187a-4ff2-a56c-49b7d300456f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:38.831049 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-b66bbdea-187a-4ff2-a56c-49b7d300456f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:38.845744 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b66bbdea-187a-4ff2-a56c-49b7d300456f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:38.846151 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b66bbdea-187a-4ff2-a56c-49b7d300456f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:38.853110 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b66bbdea-187a-4ff2-a56c-49b7d300456f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:38.854154 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b66bbdea-187a-4ff2-a56c-49b7d300456f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:38.854869 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b66bbdea-187a-4ff2-a56c-49b7d300456f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:38.855986 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b66bbdea-187a-4ff2-a56c-49b7d300456f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:38.889175 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-6742d8da-ba12-4e8d-a578-6e76699dfb86 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:38.890202 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-6742d8da-ba12-4e8d-a578-6e76699dfb86 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:38.904706 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6742d8da-ba12-4e8d-a578-6e76699dfb86 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:38.910109 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6742d8da-ba12-4e8d-a578-6e76699dfb86 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:38.911894 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6742d8da-ba12-4e8d-a578-6e76699dfb86 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:38.916883 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6742d8da-ba12-4e8d-a578-6e76699dfb86 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:38.918957 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6742d8da-ba12-4e8d-a578-6e76699dfb86 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:38.919651 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6742d8da-ba12-4e8d-a578-6e76699dfb86 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:39.691735 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b66bbdea-187a-4ff2-a56c-49b7d300456f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:39.700577 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-b66bbdea-187a-4ff2-a56c-49b7d300456f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1365 microversion: 2.1 time: 0.878044 Aug 26 15:59:39.715910 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 225/444] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:38 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1365 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:39.720778 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-65e735cf-1e19-4cfb-976a-bdc24a776f38 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:39.721500 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-65e735cf-1e19-4cfb-976a-bdc24a776f38 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:39.728475 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-65e735cf-1e19-4cfb-976a-bdc24a776f38 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:39.733400 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-65e735cf-1e19-4cfb-976a-bdc24a776f38 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:39.734116 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-65e735cf-1e19-4cfb-976a-bdc24a776f38 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:39.735176 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-65e735cf-1e19-4cfb-976a-bdc24a776f38 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:39.735815 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-65e735cf-1e19-4cfb-976a-bdc24a776f38 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:39.737595 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-65e735cf-1e19-4cfb-976a-bdc24a776f38 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:39.737704 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-6742d8da-ba12-4e8d-a578-6e76699dfb86 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:39.760190 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-6742d8da-ba12-4e8d-a578-6e76699dfb86 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1724 microversion: 2.1 time: 0.876480 Aug 26 15:59:39.761145 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 220/445] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:38 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1724 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:39.799479 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-59125a6d-97cb-41bd-8d60-54cefaee5d23 req-6b86d15e-3806-4dc9-a03b-613886f05029 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "842d5015-aa0d-46a5-8162-7201b4277653", "tag": "3b2c5b8a-cb44-484c-9531-c39f763ffef9"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:59:39.815619 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-59125a6d-97cb-41bd-8d60-54cefaee5d23 req-6b86d15e-3806-4dc9-a03b-613886f05029 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:39.827799 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-59125a6d-97cb-41bd-8d60-54cefaee5d23 req-6b86d15e-3806-4dc9-a03b-613886f05029 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:39.828253 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-59125a6d-97cb-41bd-8d60-54cefaee5d23 req-6b86d15e-3806-4dc9-a03b-613886f05029 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:39.860304 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-59125a6d-97cb-41bd-8d60-54cefaee5d23 req-6b86d15e-3806-4dc9-a03b-613886f05029 service nova] Creating event network-changed:3b2c5b8a-cb44-484c-9531-c39f763ffef9 for instance 842d5015-aa0d-46a5-8162-7201b4277653 on hv-cinder-85144 Aug 26 15:59:39.860304 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-59125a6d-97cb-41bd-8d60-54cefaee5d23 req-6b86d15e-3806-4dc9-a03b-613886f05029 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064664 Aug 26 15:59:39.864509 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 221/446] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 15:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 15:59:39.870643 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-78e0f21f-d0e0-4002-89cd-7f4264013539 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:39.871804 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-78e0f21f-d0e0-4002-89cd-7f4264013539 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:39.897763 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-78e0f21f-d0e0-4002-89cd-7f4264013539 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:39.898542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-78e0f21f-d0e0-4002-89cd-7f4264013539 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:39.899179 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-78e0f21f-d0e0-4002-89cd-7f4264013539 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:39.900145 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-78e0f21f-d0e0-4002-89cd-7f4264013539 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:39.900924 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-78e0f21f-d0e0-4002-89cd-7f4264013539 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:39.901537 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-78e0f21f-d0e0-4002-89cd-7f4264013539 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:40.173139 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-65e735cf-1e19-4cfb-976a-bdc24a776f38 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:40.181859 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-65e735cf-1e19-4cfb-976a-bdc24a776f38 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1371 microversion: 2.1 time: 0.464701 Aug 26 15:59:40.205348 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 226/447] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:39 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1371 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:40.262023 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-78e0f21f-d0e0-4002-89cd-7f4264013539 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:40.305154 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-78e0f21f-d0e0-4002-89cd-7f4264013539 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:40.310702 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-78e0f21f-d0e0-4002-89cd-7f4264013539 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:40.313900 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-78e0f21f-d0e0-4002-89cd-7f4264013539 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1741 microversion: 2.20 time: 0.447547 Aug 26 15:59:40.316129 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 222/448] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:39 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1741 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:40.739264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-db7d0e1a-39b0-475c-8f97-05d5d876fb06 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:40.740507 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-db7d0e1a-39b0-475c-8f97-05d5d876fb06 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:40.748633 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-db7d0e1a-39b0-475c-8f97-05d5d876fb06 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:40.755816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-db7d0e1a-39b0-475c-8f97-05d5d876fb06 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:40.756501 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-db7d0e1a-39b0-475c-8f97-05d5d876fb06 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:40.757287 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-db7d0e1a-39b0-475c-8f97-05d5d876fb06 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:40.757740 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-db7d0e1a-39b0-475c-8f97-05d5d876fb06 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:40.758154 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-db7d0e1a-39b0-475c-8f97-05d5d876fb06 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:40.782607 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-32a193d6-3840-47da-befb-ac35e728c71f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:40.783253 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-32a193d6-3840-47da-befb-ac35e728c71f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:40.791478 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-32a193d6-3840-47da-befb-ac35e728c71f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:40.797123 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-32a193d6-3840-47da-befb-ac35e728c71f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:40.803377 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-32a193d6-3840-47da-befb-ac35e728c71f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:40.805002 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-32a193d6-3840-47da-befb-ac35e728c71f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:40.805916 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-32a193d6-3840-47da-befb-ac35e728c71f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:40.806610 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-32a193d6-3840-47da-befb-ac35e728c71f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:41.299509 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-db7d0e1a-39b0-475c-8f97-05d5d876fb06 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:41.317991 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-db7d0e1a-39b0-475c-8f97-05d5d876fb06 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1554 microversion: 2.1 time: 0.577317 Aug 26 15:59:41.327760 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 227/449] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:40 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1554 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:41.328851 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-32a193d6-3840-47da-befb-ac35e728c71f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:41.336465 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-355e88bd-1517-4c65-ba40-5fdc68da8db1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:41.348860 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-355e88bd-1517-4c65-ba40-5fdc68da8db1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:41.348860 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-355e88bd-1517-4c65-ba40-5fdc68da8db1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:41.348860 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-355e88bd-1517-4c65-ba40-5fdc68da8db1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:41.348860 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-355e88bd-1517-4c65-ba40-5fdc68da8db1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:41.349439 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-355e88bd-1517-4c65-ba40-5fdc68da8db1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:41.349439 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-355e88bd-1517-4c65-ba40-5fdc68da8db1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:41.349439 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-355e88bd-1517-4c65-ba40-5fdc68da8db1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:41.361057 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-32a193d6-3840-47da-befb-ac35e728c71f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1724 microversion: 2.1 time: 0.581953 Aug 26 15:59:41.362356 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 223/450] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:40 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1724 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:41.367610 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-d6ec01d3-7c2f-4020-a4b9-c8162ff3ded7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:41.368387 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-d6ec01d3-7c2f-4020-a4b9-c8162ff3ded7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:41.376720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d6ec01d3-7c2f-4020-a4b9-c8162ff3ded7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:41.377484 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d6ec01d3-7c2f-4020-a4b9-c8162ff3ded7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:41.378080 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d6ec01d3-7c2f-4020-a4b9-c8162ff3ded7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:41.379064 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d6ec01d3-7c2f-4020-a4b9-c8162ff3ded7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:41.400373 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d6ec01d3-7c2f-4020-a4b9-c8162ff3ded7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:41.400926 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d6ec01d3-7c2f-4020-a4b9-c8162ff3ded7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:41.556520 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-d6ec01d3-7c2f-4020-a4b9-c8162ff3ded7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.190613 Aug 26 15:59:41.558233 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 224/451] 10.222.0.94 () {58 vars in 1275 bytes} [Fri Aug 26 15:59:41 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282/os-interface => generated 284 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:59:41.564552 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-e6377d46-87b0-4818-9d6c-16e91ab44755 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:41.565578 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-e6377d46-87b0-4818-9d6c-16e91ab44755 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:41.574139 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e6377d46-87b0-4818-9d6c-16e91ab44755 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:41.574902 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e6377d46-87b0-4818-9d6c-16e91ab44755 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:41.575380 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e6377d46-87b0-4818-9d6c-16e91ab44755 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:41.576108 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e6377d46-87b0-4818-9d6c-16e91ab44755 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:41.576718 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e6377d46-87b0-4818-9d6c-16e91ab44755 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:41.576994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e6377d46-87b0-4818-9d6c-16e91ab44755 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:41.654032 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-355e88bd-1517-4c65-ba40-5fdc68da8db1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:41.662059 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-355e88bd-1517-4c65-ba40-5fdc68da8db1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1371 microversion: 2.1 time: 0.332973 Aug 26 15:59:41.662682 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 228/452] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:41 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1371 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:41.883240 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e6377d46-87b0-4818-9d6c-16e91ab44755 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:41.893033 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e6377d46-87b0-4818-9d6c-16e91ab44755 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:41.894841 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e6377d46-87b0-4818-9d6c-16e91ab44755 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:41.896193 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-e6377d46-87b0-4818-9d6c-16e91ab44755 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1741 microversion: 2.20 time: 0.336615 Aug 26 15:59:41.896826 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 225/453] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:41 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1741 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:42.395794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-1d932764-726d-41d9-9b6b-314b4a2e1d7f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:42.397011 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-1d932764-726d-41d9-9b6b-314b4a2e1d7f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:42.410087 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1d932764-726d-41d9-9b6b-314b4a2e1d7f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:42.410087 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1d932764-726d-41d9-9b6b-314b4a2e1d7f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:42.410087 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1d932764-726d-41d9-9b6b-314b4a2e1d7f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:42.410087 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1d932764-726d-41d9-9b6b-314b4a2e1d7f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:42.410598 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1d932764-726d-41d9-9b6b-314b4a2e1d7f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:42.410598 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1d932764-726d-41d9-9b6b-314b4a2e1d7f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:42.701209 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-4e3077a9-dbbf-40d2-8875-96c5ba9cb60e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:42.702061 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-4e3077a9-dbbf-40d2-8875-96c5ba9cb60e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:42.750213 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4e3077a9-dbbf-40d2-8875-96c5ba9cb60e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:42.752185 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4e3077a9-dbbf-40d2-8875-96c5ba9cb60e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:42.752917 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4e3077a9-dbbf-40d2-8875-96c5ba9cb60e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:42.755745 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4e3077a9-dbbf-40d2-8875-96c5ba9cb60e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:42.776519 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4e3077a9-dbbf-40d2-8875-96c5ba9cb60e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:42.777267 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4e3077a9-dbbf-40d2-8875-96c5ba9cb60e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:43.393013 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-1d932764-726d-41d9-9b6b-314b4a2e1d7f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:43.409675 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-1d932764-726d-41d9-9b6b-314b4a2e1d7f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1724 microversion: 2.1 time: 1.020632 Aug 26 15:59:43.416175 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 229/454] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:42 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1724 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:43.429793 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-e990ef18-f6cb-4197-91b3-de4ed9fde2c7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:43.434085 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-e990ef18-f6cb-4197-91b3-de4ed9fde2c7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:43.450629 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e990ef18-f6cb-4197-91b3-de4ed9fde2c7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:43.452530 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e990ef18-f6cb-4197-91b3-de4ed9fde2c7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:43.453239 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e990ef18-f6cb-4197-91b3-de4ed9fde2c7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:43.454711 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e990ef18-f6cb-4197-91b3-de4ed9fde2c7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:43.456265 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e990ef18-f6cb-4197-91b3-de4ed9fde2c7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:43.457049 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e990ef18-f6cb-4197-91b3-de4ed9fde2c7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:43.478299 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-4e3077a9-dbbf-40d2-8875-96c5ba9cb60e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:43.486396 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-4e3077a9-dbbf-40d2-8875-96c5ba9cb60e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1371 microversion: 2.1 time: 0.793007 Aug 26 15:59:43.487649 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 226/455] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:42 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1371 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:59:44.003489 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-e990ef18-f6cb-4197-91b3-de4ed9fde2c7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:44.025735 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-e990ef18-f6cb-4197-91b3-de4ed9fde2c7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:44.029186 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-e990ef18-f6cb-4197-91b3-de4ed9fde2c7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:44.031517 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-e990ef18-f6cb-4197-91b3-de4ed9fde2c7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1741 microversion: 2.20 time: 0.613543 Aug 26 15:59:44.032489 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 230/456] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:43 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1741 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:44.163580 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-0f3ecb45-766c-4f83-8a7a-efc98d7df66c req-f4b43092-0af3-4d23-abcc-19136c05ecca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae11b5f9-e68f-4300-82b2-65e2acc9b282", "tag": "28a6367d-771f-4b85-b73b-d4f7949eaa49"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:59:44.176387 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-0f3ecb45-766c-4f83-8a7a-efc98d7df66c req-f4b43092-0af3-4d23-abcc-19136c05ecca service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:44.177019 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-0f3ecb45-766c-4f83-8a7a-efc98d7df66c req-f4b43092-0af3-4d23-abcc-19136c05ecca service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:44.177549 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-0f3ecb45-766c-4f83-8a7a-efc98d7df66c req-f4b43092-0af3-4d23-abcc-19136c05ecca service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:44.191986 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-0f3ecb45-766c-4f83-8a7a-efc98d7df66c req-f4b43092-0af3-4d23-abcc-19136c05ecca service nova] Creating event network-changed:28a6367d-771f-4b85-b73b-d4f7949eaa49 for instance ae11b5f9-e68f-4300-82b2-65e2acc9b282 on hv-cinder-85144 Aug 26 15:59:44.199924 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-0f3ecb45-766c-4f83-8a7a-efc98d7df66c req-f4b43092-0af3-4d23-abcc-19136c05ecca service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039973 Aug 26 15:59:44.200702 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 227/457] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 15:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:59:44.436518 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-244cda73-98a6-49c0-88fd-09ae7408330b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:44.437730 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-244cda73-98a6-49c0-88fd-09ae7408330b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:44.448847 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-244cda73-98a6-49c0-88fd-09ae7408330b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:44.450428 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-244cda73-98a6-49c0-88fd-09ae7408330b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:44.451049 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-244cda73-98a6-49c0-88fd-09ae7408330b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:44.451990 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-244cda73-98a6-49c0-88fd-09ae7408330b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:44.452824 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-244cda73-98a6-49c0-88fd-09ae7408330b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:44.453889 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-244cda73-98a6-49c0-88fd-09ae7408330b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:44.512491 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-4dbaafdd-73e5-4742-9c14-feda5dc94c9e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:44.515189 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-4dbaafdd-73e5-4742-9c14-feda5dc94c9e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:44.524794 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4dbaafdd-73e5-4742-9c14-feda5dc94c9e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:44.525882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4dbaafdd-73e5-4742-9c14-feda5dc94c9e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:44.526544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4dbaafdd-73e5-4742-9c14-feda5dc94c9e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:44.533125 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4dbaafdd-73e5-4742-9c14-feda5dc94c9e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:44.533842 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4dbaafdd-73e5-4742-9c14-feda5dc94c9e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:44.534464 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4dbaafdd-73e5-4742-9c14-feda5dc94c9e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:44.762418 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-244cda73-98a6-49c0-88fd-09ae7408330b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:44.775062 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-244cda73-98a6-49c0-88fd-09ae7408330b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1724 microversion: 2.1 time: 0.344487 Aug 26 15:59:44.776753 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-4dbaafdd-73e5-4742-9c14-feda5dc94c9e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:44.780311 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 231/458] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:44 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1724 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:44.789430 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-4dbaafdd-73e5-4742-9c14-feda5dc94c9e tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1371 microversion: 2.1 time: 0.282110 Aug 26 15:59:44.805592 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 228/459] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:44 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1371 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:45.060160 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-48f68f8b-9931-44f4-978a-c321e4cda293 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:45.063111 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-48f68f8b-9931-44f4-978a-c321e4cda293 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:45.072870 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-48f68f8b-9931-44f4-978a-c321e4cda293 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:45.073361 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-48f68f8b-9931-44f4-978a-c321e4cda293 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:45.073799 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-48f68f8b-9931-44f4-978a-c321e4cda293 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:45.075082 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-48f68f8b-9931-44f4-978a-c321e4cda293 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:45.075562 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-48f68f8b-9931-44f4-978a-c321e4cda293 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:45.075943 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-48f68f8b-9931-44f4-978a-c321e4cda293 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:45.371457 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-48f68f8b-9931-44f4-978a-c321e4cda293 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:45.381156 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-48f68f8b-9931-44f4-978a-c321e4cda293 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:45.387173 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-48f68f8b-9931-44f4-978a-c321e4cda293 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:45.387173 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-48f68f8b-9931-44f4-978a-c321e4cda293 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1741 microversion: 2.20 time: 0.333655 Aug 26 15:59:45.391646 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 232/460] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:45 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1741 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:45.798186 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-d5fe80f6-6bfe-4cac-b7fd-3a883a7d7223 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:45.798803 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-d5fe80f6-6bfe-4cac-b7fd-3a883a7d7223 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:45.806301 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d5fe80f6-6bfe-4cac-b7fd-3a883a7d7223 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:45.807335 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d5fe80f6-6bfe-4cac-b7fd-3a883a7d7223 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:45.808034 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d5fe80f6-6bfe-4cac-b7fd-3a883a7d7223 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:45.811249 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d5fe80f6-6bfe-4cac-b7fd-3a883a7d7223 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:45.811986 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d5fe80f6-6bfe-4cac-b7fd-3a883a7d7223 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:45.812545 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d5fe80f6-6bfe-4cac-b7fd-3a883a7d7223 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:45.813645 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-e5553d03-c011-425c-8a0f-57118916f871 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:45.815575 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-e5553d03-c011-425c-8a0f-57118916f871 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:45.822866 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e5553d03-c011-425c-8a0f-57118916f871 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:45.823597 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e5553d03-c011-425c-8a0f-57118916f871 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:45.824457 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e5553d03-c011-425c-8a0f-57118916f871 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:45.825176 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e5553d03-c011-425c-8a0f-57118916f871 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:45.825632 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e5553d03-c011-425c-8a0f-57118916f871 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:45.826055 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e5553d03-c011-425c-8a0f-57118916f871 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:45.834145 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=100 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:46.013733 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-d5fe80f6-6bfe-4cac-b7fd-3a883a7d7223 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:46.025199 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-d5fe80f6-6bfe-4cac-b7fd-3a883a7d7223 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1724 microversion: 2.1 time: 0.230985 Aug 26 15:59:46.042403 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-e5553d03-c011-425c-8a0f-57118916f871 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:46.042850 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 229/461] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:45 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:46.051888 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-e5553d03-c011-425c-8a0f-57118916f871 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1371 microversion: 2.1 time: 0.242006 Aug 26 15:59:46.052472 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 233/462] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:45 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:59:46.407883 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-798e27ca-1d0b-4968-90d6-cf843d38c889 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:46.408518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-798e27ca-1d0b-4968-90d6-cf843d38c889 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:46.414526 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-798e27ca-1d0b-4968-90d6-cf843d38c889 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:46.415458 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-798e27ca-1d0b-4968-90d6-cf843d38c889 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:46.415896 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-798e27ca-1d0b-4968-90d6-cf843d38c889 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:46.416581 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-798e27ca-1d0b-4968-90d6-cf843d38c889 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:46.417047 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-798e27ca-1d0b-4968-90d6-cf843d38c889 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:46.417455 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-798e27ca-1d0b-4968-90d6-cf843d38c889 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:46.548633 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-798e27ca-1d0b-4968-90d6-cf843d38c889 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:46.558369 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-798e27ca-1d0b-4968-90d6-cf843d38c889 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:46.559399 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-798e27ca-1d0b-4968-90d6-cf843d38c889 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:46.560565 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-798e27ca-1d0b-4968-90d6-cf843d38c889 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1741 microversion: 2.20 time: 0.157036 Aug 26 15:59:46.561127 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 230/463] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:46 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1741 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:47.050163 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-528d15e7-a021-4548-9842-8670fe9aeb13 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:47.051053 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-528d15e7-a021-4548-9842-8670fe9aeb13 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:47.059172 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-528d15e7-a021-4548-9842-8670fe9aeb13 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:47.060249 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-528d15e7-a021-4548-9842-8670fe9aeb13 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:47.060249 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-528d15e7-a021-4548-9842-8670fe9aeb13 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:47.061305 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-528d15e7-a021-4548-9842-8670fe9aeb13 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:47.062036 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-528d15e7-a021-4548-9842-8670fe9aeb13 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:47.062715 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-528d15e7-a021-4548-9842-8670fe9aeb13 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:47.075345 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-04878b62-58e7-4e56-a4d7-65fff0fa6ce2 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:47.075345 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-04878b62-58e7-4e56-a4d7-65fff0fa6ce2 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:47.082118 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-04878b62-58e7-4e56-a4d7-65fff0fa6ce2 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:47.082729 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-04878b62-58e7-4e56-a4d7-65fff0fa6ce2 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:47.083320 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-04878b62-58e7-4e56-a4d7-65fff0fa6ce2 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:47.084295 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-04878b62-58e7-4e56-a4d7-65fff0fa6ce2 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:47.084855 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-04878b62-58e7-4e56-a4d7-65fff0fa6ce2 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:47.085380 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-04878b62-58e7-4e56-a4d7-65fff0fa6ce2 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:47.262676 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-528d15e7-a021-4548-9842-8670fe9aeb13 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:47.271047 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-528d15e7-a021-4548-9842-8670fe9aeb13 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1724 microversion: 2.1 time: 0.225060 Aug 26 15:59:47.271617 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 234/464] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:47 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:47.279572 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-04878b62-58e7-4e56-a4d7-65fff0fa6ce2 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:47.287498 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-04878b62-58e7-4e56-a4d7-65fff0fa6ce2 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1371 microversion: 2.1 time: 0.218537 Aug 26 15:59:47.288054 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 231/465] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:47 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1371 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:59:47.585421 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-fb032cd0-87e0-432a-ac49-5fe33d4abf88 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:47.586056 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-fb032cd0-87e0-432a-ac49-5fe33d4abf88 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:47.592244 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fb032cd0-87e0-432a-ac49-5fe33d4abf88 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:47.592707 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fb032cd0-87e0-432a-ac49-5fe33d4abf88 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:47.593176 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fb032cd0-87e0-432a-ac49-5fe33d4abf88 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:47.593923 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fb032cd0-87e0-432a-ac49-5fe33d4abf88 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:47.594382 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fb032cd0-87e0-432a-ac49-5fe33d4abf88 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:47.594816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fb032cd0-87e0-432a-ac49-5fe33d4abf88 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:47.736525 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-fb032cd0-87e0-432a-ac49-5fe33d4abf88 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:47.744992 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-fb032cd0-87e0-432a-ac49-5fe33d4abf88 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:47.746453 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-fb032cd0-87e0-432a-ac49-5fe33d4abf88 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:47.747650 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-fb032cd0-87e0-432a-ac49-5fe33d4abf88 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1741 microversion: 2.20 time: 0.166426 Aug 26 15:59:47.748217 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 235/466] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:47 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1741 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:48.294022 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-2834872e-87da-442d-818c-8e5ea54fe748 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:48.294563 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-2834872e-87da-442d-818c-8e5ea54fe748 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:48.301094 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2834872e-87da-442d-818c-8e5ea54fe748 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:48.301608 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2834872e-87da-442d-818c-8e5ea54fe748 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:48.302052 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2834872e-87da-442d-818c-8e5ea54fe748 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:48.302750 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2834872e-87da-442d-818c-8e5ea54fe748 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:48.303361 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2834872e-87da-442d-818c-8e5ea54fe748 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:48.303794 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2834872e-87da-442d-818c-8e5ea54fe748 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:48.308237 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-71ea2cd9-4752-42d9-8831-622f41b2ca3d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:48.308846 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-71ea2cd9-4752-42d9-8831-622f41b2ca3d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:48.315594 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-71ea2cd9-4752-42d9-8831-622f41b2ca3d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:48.316342 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-71ea2cd9-4752-42d9-8831-622f41b2ca3d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:48.316944 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-71ea2cd9-4752-42d9-8831-622f41b2ca3d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:48.317819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-71ea2cd9-4752-42d9-8831-622f41b2ca3d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:48.318482 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-71ea2cd9-4752-42d9-8831-622f41b2ca3d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:48.319099 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-71ea2cd9-4752-42d9-8831-622f41b2ca3d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:48.506131 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-2834872e-87da-442d-818c-8e5ea54fe748 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:48.514631 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-71ea2cd9-4752-42d9-8831-622f41b2ca3d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:48.516175 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-2834872e-87da-442d-818c-8e5ea54fe748 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1724 microversion: 2.1 time: 0.226898 Aug 26 15:59:48.516965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 232/467] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:48 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:48.531073 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-71ea2cd9-4752-42d9-8831-622f41b2ca3d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1371 microversion: 2.1 time: 0.226657 Aug 26 15:59:48.531969 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 236/468] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:48 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:59:48.770821 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-61a6c55c-f719-438d-a45f-65829cab985a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:48.771394 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-61a6c55c-f719-438d-a45f-65829cab985a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:48.777636 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-61a6c55c-f719-438d-a45f-65829cab985a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:48.778116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-61a6c55c-f719-438d-a45f-65829cab985a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:48.778780 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-61a6c55c-f719-438d-a45f-65829cab985a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:48.779403 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-61a6c55c-f719-438d-a45f-65829cab985a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:48.779829 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-61a6c55c-f719-438d-a45f-65829cab985a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:48.780268 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-61a6c55c-f719-438d-a45f-65829cab985a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:48.923671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-61a6c55c-f719-438d-a45f-65829cab985a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:48.933485 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-61a6c55c-f719-438d-a45f-65829cab985a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:48.934996 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-61a6c55c-f719-438d-a45f-65829cab985a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:48.936169 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-61a6c55c-f719-438d-a45f-65829cab985a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1723 microversion: 2.20 time: 0.169498 Aug 26 15:59:48.936735 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 233/469] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:48 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:49.132584 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-1442678c-79b5-449c-b811-c63cc4687947 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-22784203", "imageRef": "bcbdbb0c-7335-4427-a636-e2dc730274b6", "flavorRef": "452"}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:59:49.193671 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.network.neutron [None req-1442678c-79b5-449c-b811-c63cc4687947 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] validate_networks() for None {{(pid=128305) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 15:59:49.495880 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-1442678c-79b5-449c-b811-c63cc4687947 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Flavor limits 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 15:59:49.496754 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-1442678c-79b5-449c-b811-c63cc4687947 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Image limits 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 15:59:49.496891 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-1442678c-79b5-449c-b811-c63cc4687947 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Flavor pref 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 15:59:49.497211 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-1442678c-79b5-449c-b811-c63cc4687947 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Image pref 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 15:59:49.497622 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-1442678c-79b5-449c-b811-c63cc4687947 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 15:59:49.508002 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1442678c-79b5-449c-b811-c63cc4687947 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:49.509377 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1442678c-79b5-449c-b811-c63cc4687947 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:49.509894 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1442678c-79b5-449c-b811-c63cc4687947 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:49.510718 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1442678c-79b5-449c-b811-c63cc4687947 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:49.511273 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1442678c-79b5-449c-b811-c63cc4687947 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:49.511768 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1442678c-79b5-449c-b811-c63cc4687947 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:49.531855 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-1442678c-79b5-449c-b811-c63cc4687947 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Getting quotas for project aa98d1bd1c354b38b99eb85b741e44ab. Resources: {'instances', 'ram', 'cores'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 15:59:49.538378 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-1442678c-79b5-449c-b811-c63cc4687947 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Getting quotas for user 796e6d2c1d3a4ef59c464fb2e61affe5 and project aa98d1bd1c354b38b99eb85b741e44ab. Resources: {'instances', 'ram', 'cores'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 15:59:49.545587 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-9e7e4e0e-3a5c-40f7-aaeb-a2d20a9aa96f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:49.548108 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-9e7e4e0e-3a5c-40f7-aaeb-a2d20a9aa96f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:49.551034 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-1442678c-79b5-449c-b811-c63cc4687947 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Going to run 1 instances... {{(pid=128305) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 15:59:49.553427 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-1442678c-79b5-449c-b811-c63cc4687947 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bcbdbb0c-7335-4427-a636-e2dc730274b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128305) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 15:59:49.571454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9e7e4e0e-3a5c-40f7-aaeb-a2d20a9aa96f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:49.578760 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9e7e4e0e-3a5c-40f7-aaeb-a2d20a9aa96f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:49.580668 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9e7e4e0e-3a5c-40f7-aaeb-a2d20a9aa96f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:49.582665 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9e7e4e0e-3a5c-40f7-aaeb-a2d20a9aa96f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:49.583421 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9e7e4e0e-3a5c-40f7-aaeb-a2d20a9aa96f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:49.584145 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9e7e4e0e-3a5c-40f7-aaeb-a2d20a9aa96f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:49.732815 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-1442678c-79b5-449c-b811-c63cc4687947 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604034 Aug 26 15:59:49.737750 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 237/470] 10.222.0.94 () {60 vars in 1147 bytes} [Fri Aug 26 15:59:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 15:59:49.749310 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a2702967-c0e6-4699-92e8-1f950bb0b822 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:49.750479 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a2702967-c0e6-4699-92e8-1f950bb0b822 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:49.760998 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a2702967-c0e6-4699-92e8-1f950bb0b822 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:49.762059 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a2702967-c0e6-4699-92e8-1f950bb0b822 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:49.762698 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a2702967-c0e6-4699-92e8-1f950bb0b822 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:49.763698 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a2702967-c0e6-4699-92e8-1f950bb0b822 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:49.764747 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a2702967-c0e6-4699-92e8-1f950bb0b822 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:49.765449 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a2702967-c0e6-4699-92e8-1f950bb0b822 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:49.787082 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-9e7e4e0e-3a5c-40f7-aaeb-a2d20a9aa96f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:49.799487 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-9e7e4e0e-3a5c-40f7-aaeb-a2d20a9aa96f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1724 microversion: 2.1 time: 0.264125 Aug 26 15:59:49.812939 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 234/471] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:49 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:49.812939 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-bdf43cb5-237b-4c64-91c9-0884cdeb64b1 req-2bad83bb-2dc4-4ea2-8fab-41c413e11f08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac977a7-aa08-459a-a863-36ba667422d1", "name": "network-vif-unplugged", "status": "completed", "tag": "8a53b00a-319e-4368-a0b0-216d2f508b1d"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:59:49.822907 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-bdf43cb5-237b-4c64-91c9-0884cdeb64b1 req-2bad83bb-2dc4-4ea2-8fab-41c413e11f08 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:49.822907 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-bdf43cb5-237b-4c64-91c9-0884cdeb64b1 req-2bad83bb-2dc4-4ea2-8fab-41c413e11f08 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:49.822907 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-bdf43cb5-237b-4c64-91c9-0884cdeb64b1 req-2bad83bb-2dc4-4ea2-8fab-41c413e11f08 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:49.857686 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-bdf43cb5-237b-4c64-91c9-0884cdeb64b1 req-2bad83bb-2dc4-4ea2-8fab-41c413e11f08 service nova] Creating event network-vif-unplugged:8a53b00a-319e-4368-a0b0-216d2f508b1d for instance 8ac977a7-aa08-459a-a863-36ba667422d1 on hv-cinder-85144 Aug 26 15:59:49.862745 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-bdf43cb5-237b-4c64-91c9-0884cdeb64b1 req-2bad83bb-2dc4-4ea2-8fab-41c413e11f08 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060512 Aug 26 15:59:49.863624 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 235/472] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 15:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:59:49.871454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-6e6175b0-fed0-473a-8f68-dc19ae3224a0 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:49.872164 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-6e6175b0-fed0-473a-8f68-dc19ae3224a0 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:49.937253 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-6e6175b0-fed0-473a-8f68-dc19ae3224a0 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:49.945328 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-6e6175b0-fed0-473a-8f68-dc19ae3224a0 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1213 microversion: 2.1 time: 0.080092 Aug 26 15:59:49.948055 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 236/473] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:49 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:49.963545 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-0f30ab92-3dde-473a-b963-de5907660ce6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:49.964363 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-0f30ab92-3dde-473a-b963-de5907660ce6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:49.971236 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f30ab92-3dde-473a-b963-de5907660ce6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:49.971989 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f30ab92-3dde-473a-b963-de5907660ce6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:49.972697 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f30ab92-3dde-473a-b963-de5907660ce6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:49.973930 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f30ab92-3dde-473a-b963-de5907660ce6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:49.974636 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f30ab92-3dde-473a-b963-de5907660ce6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:49.975328 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f30ab92-3dde-473a-b963-de5907660ce6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:50.021743 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a2702967-c0e6-4699-92e8-1f950bb0b822 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:50.031752 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a2702967-c0e6-4699-92e8-1f950bb0b822 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1371 microversion: 2.1 time: 0.292393 Aug 26 15:59:50.032732 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 238/474] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:49 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1371 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:50.137027 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-0f30ab92-3dde-473a-b963-de5907660ce6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:50.145469 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-0f30ab92-3dde-473a-b963-de5907660ce6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:50.146906 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-0f30ab92-3dde-473a-b963-de5907660ce6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:50.148090 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-0f30ab92-3dde-473a-b963-de5907660ce6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1723 microversion: 2.20 time: 0.189450 Aug 26 15:59:50.148646 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 237/475] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:49 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:50.833745 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-95b24c58-a11a-43df-9740-733704e37b4d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:50.834378 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-95b24c58-a11a-43df-9740-733704e37b4d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:50.841957 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-95b24c58-a11a-43df-9740-733704e37b4d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:50.842553 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-95b24c58-a11a-43df-9740-733704e37b4d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:50.843037 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-95b24c58-a11a-43df-9740-733704e37b4d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:50.843949 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-95b24c58-a11a-43df-9740-733704e37b4d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:50.844841 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-95b24c58-a11a-43df-9740-733704e37b4d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:50.844841 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-95b24c58-a11a-43df-9740-733704e37b4d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:50.971783 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-2b23575c-ed4f-4fae-b7d3-40342beb57a1 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:50.972499 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-2b23575c-ed4f-4fae-b7d3-40342beb57a1 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:51.003964 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-95b24c58-a11a-43df-9740-733704e37b4d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:51.013706 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-95b24c58-a11a-43df-9740-733704e37b4d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1724 microversion: 2.1 time: 0.186793 Aug 26 15:59:51.014292 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 239/476] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:50 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:51.031177 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-2b23575c-ed4f-4fae-b7d3-40342beb57a1 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:51.038614 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-2b23575c-ed4f-4fae-b7d3-40342beb57a1 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1213 microversion: 2.1 time: 0.070461 Aug 26 15:59:51.039004 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 238/477] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:50 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:59:51.064261 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-6e9c080d-2d28-4275-96a8-89545e39e097 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:51.069024 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-6e9c080d-2d28-4275-96a8-89545e39e097 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:51.075056 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6e9c080d-2d28-4275-96a8-89545e39e097 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:51.075513 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6e9c080d-2d28-4275-96a8-89545e39e097 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:51.075946 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6e9c080d-2d28-4275-96a8-89545e39e097 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:51.076677 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6e9c080d-2d28-4275-96a8-89545e39e097 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:51.077123 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6e9c080d-2d28-4275-96a8-89545e39e097 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:51.077546 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6e9c080d-2d28-4275-96a8-89545e39e097 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:51.172203 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-564c79c5-3013-4c2f-9235-607ce42e552e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:51.172203 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-564c79c5-3013-4c2f-9235-607ce42e552e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:51.179617 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-564c79c5-3013-4c2f-9235-607ce42e552e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:51.180228 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-564c79c5-3013-4c2f-9235-607ce42e552e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:51.181377 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-564c79c5-3013-4c2f-9235-607ce42e552e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:51.182238 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-564c79c5-3013-4c2f-9235-607ce42e552e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:51.182754 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-564c79c5-3013-4c2f-9235-607ce42e552e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:51.183439 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-564c79c5-3013-4c2f-9235-607ce42e552e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:51.244512 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-6e9c080d-2d28-4275-96a8-89545e39e097 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:51.252468 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-6e9c080d-2d28-4275-96a8-89545e39e097 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1371 microversion: 2.1 time: 0.202162 Aug 26 15:59:51.253048 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 240/478] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:51 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1371 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:51.335745 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-564c79c5-3013-4c2f-9235-607ce42e552e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:51.345817 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-564c79c5-3013-4c2f-9235-607ce42e552e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:51.347283 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-564c79c5-3013-4c2f-9235-607ce42e552e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:51.348482 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-564c79c5-3013-4c2f-9235-607ce42e552e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1723 microversion: 2.20 time: 0.181086 Aug 26 15:59:51.349139 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 239/479] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:51 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:52.038713 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-2dd3ac68-c89b-4c0b-9c17-1ba92818de53 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:52.039833 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-2dd3ac68-c89b-4c0b-9c17-1ba92818de53 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:52.047754 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2dd3ac68-c89b-4c0b-9c17-1ba92818de53 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:52.048295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2dd3ac68-c89b-4c0b-9c17-1ba92818de53 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:52.048735 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2dd3ac68-c89b-4c0b-9c17-1ba92818de53 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:52.049441 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2dd3ac68-c89b-4c0b-9c17-1ba92818de53 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:52.050075 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2dd3ac68-c89b-4c0b-9c17-1ba92818de53 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:52.050541 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2dd3ac68-c89b-4c0b-9c17-1ba92818de53 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:52.063638 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-866da24b-7f4e-4249-bfce-478fcc179953 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:52.064504 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-866da24b-7f4e-4249-bfce-478fcc179953 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:52.074850 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-866da24b-7f4e-4249-bfce-478fcc179953 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:52.075505 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-866da24b-7f4e-4249-bfce-478fcc179953 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:52.076238 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-866da24b-7f4e-4249-bfce-478fcc179953 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:52.077023 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-866da24b-7f4e-4249-bfce-478fcc179953 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:52.077536 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-866da24b-7f4e-4249-bfce-478fcc179953 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:52.078096 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-866da24b-7f4e-4249-bfce-478fcc179953 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:52.193110 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-866da24b-7f4e-4249-bfce-478fcc179953 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:52.205795 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-866da24b-7f4e-4249-bfce-478fcc179953 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1217 microversion: 2.1 time: 0.146830 Aug 26 15:59:52.207093 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 240/480] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:52 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1217 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:52.273852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-e76860fb-8fdb-44e8-bbfc-bcda41f71ac6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:52.274637 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-e76860fb-8fdb-44e8-bbfc-bcda41f71ac6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:52.281041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e76860fb-8fdb-44e8-bbfc-bcda41f71ac6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:52.285164 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e76860fb-8fdb-44e8-bbfc-bcda41f71ac6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:52.285164 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e76860fb-8fdb-44e8-bbfc-bcda41f71ac6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:52.285164 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e76860fb-8fdb-44e8-bbfc-bcda41f71ac6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:52.285164 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e76860fb-8fdb-44e8-bbfc-bcda41f71ac6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:52.286077 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e76860fb-8fdb-44e8-bbfc-bcda41f71ac6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:52.295608 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-2dd3ac68-c89b-4c0b-9c17-1ba92818de53 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:52.295608 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=100 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:52.300322 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-2dd3ac68-c89b-4c0b-9c17-1ba92818de53 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1724 microversion: 2.1 time: 0.268980 Aug 26 15:59:52.301359 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 241/481] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:52 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1724 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:52.372414 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-0d39759a-504e-4430-8bc5-8e703a5da9b8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:52.373075 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-0d39759a-504e-4430-8bc5-8e703a5da9b8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:52.381959 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0d39759a-504e-4430-8bc5-8e703a5da9b8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:52.381959 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0d39759a-504e-4430-8bc5-8e703a5da9b8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:52.381959 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0d39759a-504e-4430-8bc5-8e703a5da9b8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:52.381959 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0d39759a-504e-4430-8bc5-8e703a5da9b8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:52.382390 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0d39759a-504e-4430-8bc5-8e703a5da9b8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:52.382390 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0d39759a-504e-4430-8bc5-8e703a5da9b8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:52.463648 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e76860fb-8fdb-44e8-bbfc-bcda41f71ac6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:52.471898 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-e76860fb-8fdb-44e8-bbfc-bcda41f71ac6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1371 microversion: 2.1 time: 0.202305 Aug 26 15:59:52.472489 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 241/482] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:52 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1371 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:59:52.533137 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-0d39759a-504e-4430-8bc5-8e703a5da9b8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:52.542139 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-0d39759a-504e-4430-8bc5-8e703a5da9b8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:52.543705 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-0d39759a-504e-4430-8bc5-8e703a5da9b8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:52.544959 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-0d39759a-504e-4430-8bc5-8e703a5da9b8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1723 microversion: 2.20 time: 0.177287 Aug 26 15:59:52.545602 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 242/483] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:52 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:59:53.229356 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-d40f1546-0951-4d38-8355-d8a4603f4abe tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:53.232999 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-d40f1546-0951-4d38-8355-d8a4603f4abe tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:53.252484 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d40f1546-0951-4d38-8355-d8a4603f4abe tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:53.254758 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d40f1546-0951-4d38-8355-d8a4603f4abe tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:53.255961 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d40f1546-0951-4d38-8355-d8a4603f4abe tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:53.258879 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d40f1546-0951-4d38-8355-d8a4603f4abe tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:53.263030 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d40f1546-0951-4d38-8355-d8a4603f4abe tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:53.263796 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d40f1546-0951-4d38-8355-d8a4603f4abe tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:53.330759 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-de0d90b1-8d87-497a-9fe1-ce69bfc8e26a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:53.335895 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-de0d90b1-8d87-497a-9fe1-ce69bfc8e26a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:53.345226 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-de0d90b1-8d87-497a-9fe1-ce69bfc8e26a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:53.346908 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-de0d90b1-8d87-497a-9fe1-ce69bfc8e26a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:53.347873 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-de0d90b1-8d87-497a-9fe1-ce69bfc8e26a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:53.349592 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-de0d90b1-8d87-497a-9fe1-ce69bfc8e26a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:53.350793 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-de0d90b1-8d87-497a-9fe1-ce69bfc8e26a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:53.352767 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-de0d90b1-8d87-497a-9fe1-ce69bfc8e26a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:53.425096 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-d40f1546-0951-4d38-8355-d8a4603f4abe tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:53.438457 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-d40f1546-0951-4d38-8355-d8a4603f4abe tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1217 microversion: 2.1 time: 0.214168 Aug 26 15:59:53.439478 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 242/484] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:53 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1217 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:53.496086 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-0e6f0945-dc94-47f4-92f1-19e6319d9ab9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:53.509929 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-0e6f0945-dc94-47f4-92f1-19e6319d9ab9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:53.509929 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0e6f0945-dc94-47f4-92f1-19e6319d9ab9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:53.509929 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0e6f0945-dc94-47f4-92f1-19e6319d9ab9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:53.509929 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0e6f0945-dc94-47f4-92f1-19e6319d9ab9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:53.511782 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0e6f0945-dc94-47f4-92f1-19e6319d9ab9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:53.512260 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0e6f0945-dc94-47f4-92f1-19e6319d9ab9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:53.512700 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0e6f0945-dc94-47f4-92f1-19e6319d9ab9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:53.719445 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-de0d90b1-8d87-497a-9fe1-ce69bfc8e26a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:53.729019 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-de0d90b1-8d87-497a-9fe1-ce69bfc8e26a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1724 microversion: 2.1 time: 0.408071 Aug 26 15:59:53.730046 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 243/485] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:53 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1724 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:53.737855 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-3132aa2a-5cd1-489f-ad05-92ef3dab83da tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:53.738766 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-3132aa2a-5cd1-489f-ad05-92ef3dab83da tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:53.749846 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3132aa2a-5cd1-489f-ad05-92ef3dab83da tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:53.750548 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3132aa2a-5cd1-489f-ad05-92ef3dab83da tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:53.751022 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3132aa2a-5cd1-489f-ad05-92ef3dab83da tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:53.751747 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3132aa2a-5cd1-489f-ad05-92ef3dab83da tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:53.752205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3132aa2a-5cd1-489f-ad05-92ef3dab83da tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:53.752631 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3132aa2a-5cd1-489f-ad05-92ef3dab83da tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:53.812116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-0e6f0945-dc94-47f4-92f1-19e6319d9ab9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:53.820773 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-0e6f0945-dc94-47f4-92f1-19e6319d9ab9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1371 microversion: 2.1 time: 0.329709 Aug 26 15:59:53.824415 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 243/486] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:53 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1371 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:53.901827 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-3132aa2a-5cd1-489f-ad05-92ef3dab83da tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:53.910843 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-3132aa2a-5cd1-489f-ad05-92ef3dab83da tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:53.912336 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-3132aa2a-5cd1-489f-ad05-92ef3dab83da tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:53.913493 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-3132aa2a-5cd1-489f-ad05-92ef3dab83da tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1723 microversion: 2.20 time: 0.182162 Aug 26 15:59:53.914361 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 244/487] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:53 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:54.475545 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-c80078a8-8cde-47f3-945f-4b6b21e4f750 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:54.476307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-c80078a8-8cde-47f3-945f-4b6b21e4f750 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:54.483569 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c80078a8-8cde-47f3-945f-4b6b21e4f750 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:54.485148 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c80078a8-8cde-47f3-945f-4b6b21e4f750 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:54.485148 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c80078a8-8cde-47f3-945f-4b6b21e4f750 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:54.485426 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c80078a8-8cde-47f3-945f-4b6b21e4f750 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:54.485953 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c80078a8-8cde-47f3-945f-4b6b21e4f750 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:54.486448 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c80078a8-8cde-47f3-945f-4b6b21e4f750 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:54.552105 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-c80078a8-8cde-47f3-945f-4b6b21e4f750 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:54.561366 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-c80078a8-8cde-47f3-945f-4b6b21e4f750 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1265 microversion: 2.1 time: 0.089876 Aug 26 15:59:54.562383 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 244/488] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:54 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:54.753204 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-b2581ed1-9bb9-4194-ae27-6ba8c336746f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:54.753794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-b2581ed1-9bb9-4194-ae27-6ba8c336746f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:54.760733 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b2581ed1-9bb9-4194-ae27-6ba8c336746f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:54.761219 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b2581ed1-9bb9-4194-ae27-6ba8c336746f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:54.761648 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b2581ed1-9bb9-4194-ae27-6ba8c336746f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:54.762351 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b2581ed1-9bb9-4194-ae27-6ba8c336746f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:54.762807 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b2581ed1-9bb9-4194-ae27-6ba8c336746f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:54.763260 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b2581ed1-9bb9-4194-ae27-6ba8c336746f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:54.845771 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-b1e6bd9c-b416-4d19-854a-503ee86a9015 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:54.846738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-b1e6bd9c-b416-4d19-854a-503ee86a9015 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:54.853312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b1e6bd9c-b416-4d19-854a-503ee86a9015 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:54.853898 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b1e6bd9c-b416-4d19-854a-503ee86a9015 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:54.854352 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b1e6bd9c-b416-4d19-854a-503ee86a9015 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:54.855792 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b1e6bd9c-b416-4d19-854a-503ee86a9015 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:54.856378 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b1e6bd9c-b416-4d19-854a-503ee86a9015 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:54.856817 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b1e6bd9c-b416-4d19-854a-503ee86a9015 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:54.922171 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b2581ed1-9bb9-4194-ae27-6ba8c336746f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:54.932068 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-b2581ed1-9bb9-4194-ae27-6ba8c336746f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1724 microversion: 2.1 time: 0.183177 Aug 26 15:59:54.932965 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 245/489] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:54 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:54.937844 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-4d6dbe47-b947-432c-b3c1-459abb87a33c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:54.938446 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-4d6dbe47-b947-432c-b3c1-459abb87a33c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:54.945044 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4d6dbe47-b947-432c-b3c1-459abb87a33c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:54.945810 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4d6dbe47-b947-432c-b3c1-459abb87a33c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:54.948869 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4d6dbe47-b947-432c-b3c1-459abb87a33c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:54.948869 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4d6dbe47-b947-432c-b3c1-459abb87a33c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:54.948869 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4d6dbe47-b947-432c-b3c1-459abb87a33c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:54.948869 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4d6dbe47-b947-432c-b3c1-459abb87a33c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:55.048223 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-b1e6bd9c-b416-4d19-854a-503ee86a9015 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:55.057119 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-b1e6bd9c-b416-4d19-854a-503ee86a9015 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1371 microversion: 2.1 time: 0.217748 Aug 26 15:59:55.058080 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 245/490] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:54 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1371 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:55.112562 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-4d6dbe47-b947-432c-b3c1-459abb87a33c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:55.120986 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-4d6dbe47-b947-432c-b3c1-459abb87a33c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:55.123494 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-4d6dbe47-b947-432c-b3c1-459abb87a33c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:55.123858 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-4d6dbe47-b947-432c-b3c1-459abb87a33c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1723 microversion: 2.20 time: 0.189903 Aug 26 15:59:55.124371 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 246/491] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:54 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:55.583258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-64730663-0edc-42cc-9075-9856f39c3bde tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:55.583867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-64730663-0edc-42cc-9075-9856f39c3bde tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:55.586235 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_api:SELECT=96 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:55.592229 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-64730663-0edc-42cc-9075-9856f39c3bde tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:55.592714 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-64730663-0edc-42cc-9075-9856f39c3bde tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:55.593151 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-64730663-0edc-42cc-9075-9856f39c3bde tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:55.593854 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-64730663-0edc-42cc-9075-9856f39c3bde tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:55.594313 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-64730663-0edc-42cc-9075-9856f39c3bde tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:55.594735 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-64730663-0edc-42cc-9075-9856f39c3bde tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:55.662040 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-64730663-0edc-42cc-9075-9856f39c3bde tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:55.671984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-64730663-0edc-42cc-9075-9856f39c3bde tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1265 microversion: 2.1 time: 0.092386 Aug 26 15:59:55.672794 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 246/492] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:55 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:55.954510 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-7cecc9d6-e4b4-4271-b0dc-90593e23eac4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:55.955293 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-7cecc9d6-e4b4-4271-b0dc-90593e23eac4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:55.961668 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7cecc9d6-e4b4-4271-b0dc-90593e23eac4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:55.962156 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7cecc9d6-e4b4-4271-b0dc-90593e23eac4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:55.962673 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7cecc9d6-e4b4-4271-b0dc-90593e23eac4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:55.963406 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7cecc9d6-e4b4-4271-b0dc-90593e23eac4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:55.963861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7cecc9d6-e4b4-4271-b0dc-90593e23eac4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:55.964286 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7cecc9d6-e4b4-4271-b0dc-90593e23eac4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:56.078948 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-a8ce4556-305a-4525-8c3e-bc87bae30b71 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:56.080276 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-a8ce4556-305a-4525-8c3e-bc87bae30b71 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:56.098831 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a8ce4556-305a-4525-8c3e-bc87bae30b71 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:56.099355 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a8ce4556-305a-4525-8c3e-bc87bae30b71 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:56.099787 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a8ce4556-305a-4525-8c3e-bc87bae30b71 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:56.100494 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a8ce4556-305a-4525-8c3e-bc87bae30b71 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:56.100972 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a8ce4556-305a-4525-8c3e-bc87bae30b71 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:56.101496 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a8ce4556-305a-4525-8c3e-bc87bae30b71 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:56.103245 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-7cecc9d6-e4b4-4271-b0dc-90593e23eac4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:56.114768 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-7cecc9d6-e4b4-4271-b0dc-90593e23eac4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1724 microversion: 2.1 time: 0.164038 Aug 26 15:59:56.115406 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 247/493] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:55 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:56.147599 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a0a2119b-a021-4e2b-8488-b0601eb82083 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:56.148405 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a0a2119b-a021-4e2b-8488-b0601eb82083 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:56.154764 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a0a2119b-a021-4e2b-8488-b0601eb82083 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:56.155008 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a0a2119b-a021-4e2b-8488-b0601eb82083 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:56.155330 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a0a2119b-a021-4e2b-8488-b0601eb82083 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:56.156074 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a0a2119b-a021-4e2b-8488-b0601eb82083 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:56.156520 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a0a2119b-a021-4e2b-8488-b0601eb82083 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:56.156931 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a0a2119b-a021-4e2b-8488-b0601eb82083 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:56.297050 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-a8ce4556-305a-4525-8c3e-bc87bae30b71 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:56.308948 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-a8ce4556-305a-4525-8c3e-bc87bae30b71 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1371 microversion: 2.1 time: 0.234286 Aug 26 15:59:56.309754 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 247/494] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:56 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1371 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:56.335295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a0a2119b-a021-4e2b-8488-b0601eb82083 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:56.350455 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a0a2119b-a021-4e2b-8488-b0601eb82083 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:56.351467 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-1933d827-53ab-493c-a097-cd6a74c877ed req-46b74ac2-0792-4930-a08e-4e9c46b331cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "842d5015-aa0d-46a5-8162-7201b4277653", "name": "network-vif-plugged", "status": "completed", "tag": "3b2c5b8a-cb44-484c-9531-c39f763ffef9"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:59:56.352534 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a0a2119b-a021-4e2b-8488-b0601eb82083 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:56.354116 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a0a2119b-a021-4e2b-8488-b0601eb82083 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1723 microversion: 2.20 time: 0.211065 Aug 26 15:59:56.366848 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-1933d827-53ab-493c-a097-cd6a74c877ed req-46b74ac2-0792-4930-a08e-4e9c46b331cd service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:56.368341 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-1933d827-53ab-493c-a097-cd6a74c877ed req-46b74ac2-0792-4930-a08e-4e9c46b331cd service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:56.369395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 248/495] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:56 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 15:59:56.370496 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-1933d827-53ab-493c-a097-cd6a74c877ed req-46b74ac2-0792-4930-a08e-4e9c46b331cd service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:56.385045 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-1933d827-53ab-493c-a097-cd6a74c877ed req-46b74ac2-0792-4930-a08e-4e9c46b331cd service nova] Creating event network-vif-plugged:3b2c5b8a-cb44-484c-9531-c39f763ffef9 for instance 842d5015-aa0d-46a5-8162-7201b4277653 on hv-cinder-85144 Aug 26 15:59:56.387877 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-1933d827-53ab-493c-a097-cd6a74c877ed req-46b74ac2-0792-4930-a08e-4e9c46b331cd service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041210 Aug 26 15:59:56.388674 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 248/496] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 15:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 15:59:56.694389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-333cc262-91e0-45fd-8a69-7783d95f4057 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:56.695582 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-333cc262-91e0-45fd-8a69-7783d95f4057 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:56.703550 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-333cc262-91e0-45fd-8a69-7783d95f4057 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:56.704313 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-333cc262-91e0-45fd-8a69-7783d95f4057 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:56.704770 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-333cc262-91e0-45fd-8a69-7783d95f4057 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:56.705669 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-333cc262-91e0-45fd-8a69-7783d95f4057 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:56.706213 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-333cc262-91e0-45fd-8a69-7783d95f4057 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:56.706637 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-333cc262-91e0-45fd-8a69-7783d95f4057 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:56.780651 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-333cc262-91e0-45fd-8a69-7783d95f4057 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:56.792287 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-333cc262-91e0-45fd-8a69-7783d95f4057 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1265 microversion: 2.1 time: 0.102091 Aug 26 15:59:56.792900 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 249/497] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:56 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1265 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:59:57.139611 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-c211f7a9-2035-42a1-ba55-b18a90111c02 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:57.140332 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-c211f7a9-2035-42a1-ba55-b18a90111c02 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:57.146968 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c211f7a9-2035-42a1-ba55-b18a90111c02 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:57.155101 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c211f7a9-2035-42a1-ba55-b18a90111c02 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:57.155101 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c211f7a9-2035-42a1-ba55-b18a90111c02 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:57.155101 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c211f7a9-2035-42a1-ba55-b18a90111c02 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:57.155101 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c211f7a9-2035-42a1-ba55-b18a90111c02 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:57.155515 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c211f7a9-2035-42a1-ba55-b18a90111c02 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:57.165822 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=100 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:57.329474 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-c211f7a9-2035-42a1-ba55-b18a90111c02 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:57.332789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-5d8856d5-404b-4d1a-854b-ede99e3d9379 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:57.332789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-5d8856d5-404b-4d1a-854b-ede99e3d9379 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:57.339348 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5d8856d5-404b-4d1a-854b-ede99e3d9379 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:57.339985 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5d8856d5-404b-4d1a-854b-ede99e3d9379 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:57.340630 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5d8856d5-404b-4d1a-854b-ede99e3d9379 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:57.341344 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5d8856d5-404b-4d1a-854b-ede99e3d9379 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:57.341842 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5d8856d5-404b-4d1a-854b-ede99e3d9379 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:57.342316 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-c211f7a9-2035-42a1-ba55-b18a90111c02 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1701 microversion: 2.1 time: 0.209039 Aug 26 15:59:57.342440 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5d8856d5-404b-4d1a-854b-ede99e3d9379 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:57.349806 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 249/498] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:57 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1701 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:59:57.367210 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-3f935028-ab3d-4eb8-9d29-ea66f1624b94 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:59:57.378018 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3f935028-ab3d-4eb8-9d29-ea66f1624b94 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:57.378018 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3f935028-ab3d-4eb8-9d29-ea66f1624b94 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:57.378946 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3f935028-ab3d-4eb8-9d29-ea66f1624b94 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:57.447941 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-3f935028-ab3d-4eb8-9d29-ea66f1624b94 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Going to try to start instance {{(pid=128304) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 26 15:59:57.499619 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-5d8856d5-404b-4d1a-854b-ede99e3d9379 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:57.507304 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-5d8856d5-404b-4d1a-854b-ede99e3d9379 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1371 microversion: 2.1 time: 0.181312 Aug 26 15:59:57.507872 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 250/499] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:57 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:59:57.512756 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-536669d6-d2ae-4a52-b7ef-146a2615f557 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:57.513349 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-536669d6-d2ae-4a52-b7ef-146a2615f557 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:57.522817 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-536669d6-d2ae-4a52-b7ef-146a2615f557 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:57.523666 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-536669d6-d2ae-4a52-b7ef-146a2615f557 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:57.524720 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-536669d6-d2ae-4a52-b7ef-146a2615f557 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:57.525446 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-536669d6-d2ae-4a52-b7ef-146a2615f557 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:57.525930 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-536669d6-d2ae-4a52-b7ef-146a2615f557 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:57.526354 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-536669d6-d2ae-4a52-b7ef-146a2615f557 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:57.665184 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-3f935028-ab3d-4eb8-9d29-ea66f1624b94 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "POST /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e/action" status: 202 len: 0 microversion: 2.1 time: 0.302078 Aug 26 15:59:57.668701 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 250/500] 10.222.0.94 () {60 vars in 1278 bytes} [Fri Aug 26 15:59:57 2022] POST /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 15:59:57.670902 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-a1a227ad-313a-4d9c-b855-116b2e37be41 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:57.671495 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-a1a227ad-313a-4d9c-b855-116b2e37be41 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 98316258-36ac-4e26-b92d-48fc237b5818] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:57.675204 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-536669d6-d2ae-4a52-b7ef-146a2615f557 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:57.681361 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a1a227ad-313a-4d9c-b855-116b2e37be41 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:57.681361 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a1a227ad-313a-4d9c-b855-116b2e37be41 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:57.681361 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a1a227ad-313a-4d9c-b855-116b2e37be41 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:57.681361 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a1a227ad-313a-4d9c-b855-116b2e37be41 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:57.682171 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a1a227ad-313a-4d9c-b855-116b2e37be41 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:57.682676 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a1a227ad-313a-4d9c-b855-116b2e37be41 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:57.684811 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-536669d6-d2ae-4a52-b7ef-146a2615f557 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:57.686283 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-536669d6-d2ae-4a52-b7ef-146a2615f557 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:57.687503 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-536669d6-d2ae-4a52-b7ef-146a2615f557 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1726 microversion: 2.20 time: 0.178604 Aug 26 15:59:57.688068 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 251/501] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:57 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 15:59:57.692505 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-e7ce5f1f-339c-44c9-ad13-a8929de89880 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:57.693107 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-e7ce5f1f-339c-44c9-ad13-a8929de89880 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:57.700604 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e7ce5f1f-339c-44c9-ad13-a8929de89880 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:57.701217 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e7ce5f1f-339c-44c9-ad13-a8929de89880 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:57.701661 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e7ce5f1f-339c-44c9-ad13-a8929de89880 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:57.702363 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e7ce5f1f-339c-44c9-ad13-a8929de89880 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:57.702815 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e7ce5f1f-339c-44c9-ad13-a8929de89880 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:57.703342 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e7ce5f1f-339c-44c9-ad13-a8929de89880 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:57.815216 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.objects.instance [None req-a1a227ad-313a-4d9c-b855-116b2e37be41 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lazy-loading 'services' on Instance uuid 98316258-36ac-4e26-b92d-48fc237b5818 {{(pid=128304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 15:59:57.847468 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-e7ce5f1f-339c-44c9-ad13-a8929de89880 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:57.858220 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-e7ce5f1f-339c-44c9-ad13-a8929de89880 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1710 microversion: 2.1 time: 0.169109 Aug 26 15:59:57.860911 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 252/502] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:57 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1710 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:57.866441 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-95884f71-44cb-44c0-9c33-26fc921fcf1a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "468b26a0-7c98-4ab9-bcc7-0a0726896ec1"}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:59:57.869328 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-95884f71-44cb-44c0-9c33-26fc921fcf1a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:57.875802 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-95884f71-44cb-44c0-9c33-26fc921fcf1a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:57.876281 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-95884f71-44cb-44c0-9c33-26fc921fcf1a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:57.876710 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-95884f71-44cb-44c0-9c33-26fc921fcf1a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:57.877409 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-95884f71-44cb-44c0-9c33-26fc921fcf1a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:57.877882 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-95884f71-44cb-44c0-9c33-26fc921fcf1a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:57.878371 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-95884f71-44cb-44c0-9c33-26fc921fcf1a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:58.237571 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-a1a227ad-313a-4d9c-b855-116b2e37be41 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "DELETE /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818/os-volume_attachments/915ce1ba-294c-47ad-91ca-f4fbdaee069b" status: 202 len: 0 microversion: 2.1 time: 0.570525 Aug 26 15:59:58.238179 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 251/503] 10.222.0.94 () {58 vars in 1416 bytes} [Fri Aug 26 15:59:57 2022] DELETE /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818/os-volume_attachments/915ce1ba-294c-47ad-91ca-f4fbdaee069b => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 15:59:58.244252 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-c903fe46-7268-41bd-9361-e46dad43957d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:58.244869 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-c903fe46-7268-41bd-9361-e46dad43957d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:58.251463 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c903fe46-7268-41bd-9361-e46dad43957d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:58.251950 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c903fe46-7268-41bd-9361-e46dad43957d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:58.252385 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c903fe46-7268-41bd-9361-e46dad43957d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:58.253171 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c903fe46-7268-41bd-9361-e46dad43957d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:58.253622 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c903fe46-7268-41bd-9361-e46dad43957d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:58.254216 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c903fe46-7268-41bd-9361-e46dad43957d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:58.330088 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-c903fe46-7268-41bd-9361-e46dad43957d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:58.338617 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-c903fe46-7268-41bd-9361-e46dad43957d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1273 microversion: 2.1 time: 0.099225 Aug 26 15:59:58.339551 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 252/504] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:58 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:58.528430 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-bae66c50-a8f6-43db-839b-e0e92d5bb3d7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:58.529130 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-bae66c50-a8f6-43db-839b-e0e92d5bb3d7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:58.537275 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bae66c50-a8f6-43db-839b-e0e92d5bb3d7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:58.546814 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bae66c50-a8f6-43db-839b-e0e92d5bb3d7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:58.546814 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bae66c50-a8f6-43db-839b-e0e92d5bb3d7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:58.546814 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bae66c50-a8f6-43db-839b-e0e92d5bb3d7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:58.546814 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bae66c50-a8f6-43db-839b-e0e92d5bb3d7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:58.547290 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bae66c50-a8f6-43db-839b-e0e92d5bb3d7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:58.817333 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-bae66c50-a8f6-43db-839b-e0e92d5bb3d7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:58.828160 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-bae66c50-a8f6-43db-839b-e0e92d5bb3d7 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1371 microversion: 2.1 time: 0.303702 Aug 26 15:59:58.829346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 253/505] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:58 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1371 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:58.880333 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-9891813e-40f1-4c67-9474-c1ad376336c9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:58.881089 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-9891813e-40f1-4c67-9474-c1ad376336c9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:58.888237 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9891813e-40f1-4c67-9474-c1ad376336c9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:58.889006 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9891813e-40f1-4c67-9474-c1ad376336c9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:58.889446 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9891813e-40f1-4c67-9474-c1ad376336c9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:58.890194 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9891813e-40f1-4c67-9474-c1ad376336c9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:58.890675 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9891813e-40f1-4c67-9474-c1ad376336c9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:58.891135 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9891813e-40f1-4c67-9474-c1ad376336c9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:59.066357 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-9891813e-40f1-4c67-9474-c1ad376336c9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:59.075131 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-9891813e-40f1-4c67-9474-c1ad376336c9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1710 microversion: 2.1 time: 0.198723 Aug 26 15:59:59.075954 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 254/506] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:58 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1710 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 15:59:59.221401 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-95884f71-44cb-44c0-9c33-26fc921fcf1a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "POST /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.359008 Aug 26 15:59:59.222026 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 253/507] 10.222.0.94 () {62 vars in 1364 bytes} [Fri Aug 26 15:59:57 2022] POST /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1/os-volume_attachments => generated 188 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 15:59:59.360630 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f867a6a2-75e8-4c6c-835d-64b72a53d70f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:59.361795 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-f867a6a2-75e8-4c6c-835d-64b72a53d70f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:59.371670 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f867a6a2-75e8-4c6c-835d-64b72a53d70f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:59.373629 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f867a6a2-75e8-4c6c-835d-64b72a53d70f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:59.377703 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f867a6a2-75e8-4c6c-835d-64b72a53d70f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:59.383179 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-622bb276-6334-40ea-9da0-c527dc4760b5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 15:59:59.384229 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-622bb276-6334-40ea-9da0-c527dc4760b5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:59.385183 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f867a6a2-75e8-4c6c-835d-64b72a53d70f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:59.385588 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f867a6a2-75e8-4c6c-835d-64b72a53d70f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:59.386024 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f867a6a2-75e8-4c6c-835d-64b72a53d70f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:59.391496 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-622bb276-6334-40ea-9da0-c527dc4760b5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:59.391980 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-622bb276-6334-40ea-9da0-c527dc4760b5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:59.392417 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-622bb276-6334-40ea-9da0-c527dc4760b5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:59.393351 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-622bb276-6334-40ea-9da0-c527dc4760b5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:59.393979 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-622bb276-6334-40ea-9da0-c527dc4760b5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:59.394408 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-622bb276-6334-40ea-9da0-c527dc4760b5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:59.446959 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-622bb276-6334-40ea-9da0-c527dc4760b5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128305) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 26 15:59:59.476920 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-f867a6a2-75e8-4c6c-835d-64b72a53d70f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 15:59:59.485533 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-f867a6a2-75e8-4c6c-835d-64b72a53d70f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1283 microversion: 2.1 time: 0.129069 Aug 26 15:59:59.486217 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 255/508] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:59 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1283 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 15:59:59.520807 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell0:SELECT=2 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:59.546237 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell0:SELECT=6 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:59.740841 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:59:59.850388 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-c177287b-2703-4c3f-a21c-3484a9affa51 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:59.851427 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-c177287b-2703-4c3f-a21c-3484a9affa51 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:59.858464 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-622bb276-6334-40ea-9da0-c527dc4760b5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "POST /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1/action" status: 202 len: 0 microversion: 2.20 time: 0.479155 Aug 26 15:59:59.860114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c177287b-2703-4c3f-a21c-3484a9affa51 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:59.860794 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c177287b-2703-4c3f-a21c-3484a9affa51 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:59.861390 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c177287b-2703-4c3f-a21c-3484a9affa51 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:59.862534 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c177287b-2703-4c3f-a21c-3484a9affa51 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:59.862656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 254/509] 10.222.0.94 () {62 vars in 1319 bytes} [Fri Aug 26 15:59:59 2022] POST /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 26 15:59:59.863271 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c177287b-2703-4c3f-a21c-3484a9affa51 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:59.864851 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c177287b-2703-4c3f-a21c-3484a9affa51 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:59.867800 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-4ecd232a-7310-45b1-b8ea-6abddacf2afd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 15:59:59.868413 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-4ecd232a-7310-45b1-b8ea-6abddacf2afd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 15:59:59.918396 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4ecd232a-7310-45b1-b8ea-6abddacf2afd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:59.918396 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4ecd232a-7310-45b1-b8ea-6abddacf2afd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:59.918396 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4ecd232a-7310-45b1-b8ea-6abddacf2afd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 15:59:59.918396 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4ecd232a-7310-45b1-b8ea-6abddacf2afd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 15:59:59.918760 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4ecd232a-7310-45b1-b8ea-6abddacf2afd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 15:59:59.918760 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4ecd232a-7310-45b1-b8ea-6abddacf2afd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:00.101802 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-c177287b-2703-4c3f-a21c-3484a9affa51 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:00.118215 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-c177287b-2703-4c3f-a21c-3484a9affa51 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1565 microversion: 2.1 time: 0.272223 Aug 26 16:00:00.119410 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 256/510] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 15:59:59 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1565 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:00:00.127040 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f38c95c7-5432-4c57-b303-b8e20f5fded8 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:00.132148 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-f38c95c7-5432-4c57-b303-b8e20f5fded8 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:00.156678 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f38c95c7-5432-4c57-b303-b8e20f5fded8 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:00.157390 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f38c95c7-5432-4c57-b303-b8e20f5fded8 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:00.157983 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f38c95c7-5432-4c57-b303-b8e20f5fded8 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:00.158833 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f38c95c7-5432-4c57-b303-b8e20f5fded8 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:00.159473 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f38c95c7-5432-4c57-b303-b8e20f5fded8 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:00.160049 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f38c95c7-5432-4c57-b303-b8e20f5fded8 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:00.175052 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-4ecd232a-7310-45b1-b8ea-6abddacf2afd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:00.190780 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-4ecd232a-7310-45b1-b8ea-6abddacf2afd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:00.192521 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-4ecd232a-7310-45b1-b8ea-6abddacf2afd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:00.195437 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-4ecd232a-7310-45b1-b8ea-6abddacf2afd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1812 microversion: 2.20 time: 0.330168 Aug 26 16:00:00.196062 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 255/511] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 15:59:59 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1812 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:00.204867 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a7395503-74c0-4b7a-abc6-1e5c96ec7f28 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:00.205350 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a7395503-74c0-4b7a-abc6-1e5c96ec7f28 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:00.223567 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a7395503-74c0-4b7a-abc6-1e5c96ec7f28 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:00.224903 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a7395503-74c0-4b7a-abc6-1e5c96ec7f28 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:00.225534 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a7395503-74c0-4b7a-abc6-1e5c96ec7f28 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:00.226270 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a7395503-74c0-4b7a-abc6-1e5c96ec7f28 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:00.226768 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a7395503-74c0-4b7a-abc6-1e5c96ec7f28 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:00.227394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a7395503-74c0-4b7a-abc6-1e5c96ec7f28 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:00.382491 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a7395503-74c0-4b7a-abc6-1e5c96ec7f28 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.181669 Aug 26 16:00:00.383386 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 256/512] 10.222.0.94 () {58 vars in 1275 bytes} [Fri Aug 26 16:00:00 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653/os-interface => generated 284 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:00:00.472582 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-f38c95c7-5432-4c57-b303-b8e20f5fded8 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:00.481515 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-f38c95c7-5432-4c57-b303-b8e20f5fded8 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1710 microversion: 2.1 time: 0.361222 Aug 26 16:00:00.482140 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 257/513] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:00 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1710 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:00.515669 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-719a387a-d813-4034-89ba-c4d1d26b2f3f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:00.516574 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-719a387a-d813-4034-89ba-c4d1d26b2f3f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:00.526617 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-719a387a-d813-4034-89ba-c4d1d26b2f3f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:00.527039 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-719a387a-d813-4034-89ba-c4d1d26b2f3f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:00.527516 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-719a387a-d813-4034-89ba-c4d1d26b2f3f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:00.528211 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-719a387a-d813-4034-89ba-c4d1d26b2f3f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:00.528683 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-719a387a-d813-4034-89ba-c4d1d26b2f3f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:00.529156 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-719a387a-d813-4034-89ba-c4d1d26b2f3f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:00.831171 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-719a387a-d813-4034-89ba-c4d1d26b2f3f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:00.846522 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-719a387a-d813-4034-89ba-c4d1d26b2f3f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1313 microversion: 2.1 time: 0.336779 Aug 26 16:00:00.861419 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 257/514] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:00 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:01.221430 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-42508362-02e2-4be3-be3e-7ea7230b413b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:01.223241 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-42508362-02e2-4be3-be3e-7ea7230b413b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:01.225569 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell0:SELECT=4 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:00:01.233474 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42508362-02e2-4be3-be3e-7ea7230b413b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:01.233910 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42508362-02e2-4be3-be3e-7ea7230b413b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:01.234407 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42508362-02e2-4be3-be3e-7ea7230b413b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:01.235111 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42508362-02e2-4be3-be3e-7ea7230b413b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:01.235571 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42508362-02e2-4be3-be3e-7ea7230b413b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:01.236786 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42508362-02e2-4be3-be3e-7ea7230b413b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:01.508315 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-bf482cb7-a651-4c90-84e3-171bdd7d9319 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:01.508780 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-bf482cb7-a651-4c90-84e3-171bdd7d9319 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:01.518714 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bf482cb7-a651-4c90-84e3-171bdd7d9319 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:01.519234 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bf482cb7-a651-4c90-84e3-171bdd7d9319 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:01.519718 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bf482cb7-a651-4c90-84e3-171bdd7d9319 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:01.520550 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bf482cb7-a651-4c90-84e3-171bdd7d9319 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:01.521005 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bf482cb7-a651-4c90-84e3-171bdd7d9319 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:01.521530 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bf482cb7-a651-4c90-84e3-171bdd7d9319 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:01.879627 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-42508362-02e2-4be3-be3e-7ea7230b413b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:01.887428 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-bf482cb7-a651-4c90-84e3-171bdd7d9319 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:01.891269 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-42508362-02e2-4be3-be3e-7ea7230b413b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:01.894140 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-42508362-02e2-4be3-be3e-7ea7230b413b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:01.895693 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-42508362-02e2-4be3-be3e-7ea7230b413b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1752 microversion: 2.20 time: 0.678986 Aug 26 16:00:01.901384 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-bf482cb7-a651-4c90-84e3-171bdd7d9319 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1710 microversion: 2.1 time: 0.399374 Aug 26 16:00:01.902684 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 258/515] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:01 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1710 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:01.911986 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 258/516] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:01 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1752 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:00:01.917293 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-d124e3fc-5f63-4beb-9394-afa7f2a04a2d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:01.917972 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-d124e3fc-5f63-4beb-9394-afa7f2a04a2d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:01.938833 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d124e3fc-5f63-4beb-9394-afa7f2a04a2d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:01.939563 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d124e3fc-5f63-4beb-9394-afa7f2a04a2d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:01.940013 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d124e3fc-5f63-4beb-9394-afa7f2a04a2d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:01.943533 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d124e3fc-5f63-4beb-9394-afa7f2a04a2d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:01.944250 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d124e3fc-5f63-4beb-9394-afa7f2a04a2d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:01.944816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d124e3fc-5f63-4beb-9394-afa7f2a04a2d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:02.274299 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d124e3fc-5f63-4beb-9394-afa7f2a04a2d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:02.284582 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-d124e3fc-5f63-4beb-9394-afa7f2a04a2d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1313 microversion: 2.1 time: 0.379909 Aug 26 16:00:02.285241 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 259/517] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:01 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:02.609658 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-8a0bfb80-08d1-40d6-9fc1-5280c07e2ba2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:02.610262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-8a0bfb80-08d1-40d6-9fc1-5280c07e2ba2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 98316258-36ac-4e26-b92d-48fc237b5818] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:02.616973 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8a0bfb80-08d1-40d6-9fc1-5280c07e2ba2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:02.617468 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8a0bfb80-08d1-40d6-9fc1-5280c07e2ba2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:02.617900 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8a0bfb80-08d1-40d6-9fc1-5280c07e2ba2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:02.618613 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8a0bfb80-08d1-40d6-9fc1-5280c07e2ba2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:02.619151 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8a0bfb80-08d1-40d6-9fc1-5280c07e2ba2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:02.619572 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8a0bfb80-08d1-40d6-9fc1-5280c07e2ba2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:02.653113 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-8a0bfb80-08d1-40d6-9fc1-5280c07e2ba2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 98316258-36ac-4e26-b92d-48fc237b5818] Going to try to terminate instance {{(pid=128304) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 16:00:02.704807 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-c3bf7755-4498-490e-8506-10051b282ea5 req-5963228d-a365-44d9-ba0c-bf835d99ce50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "842d5015-aa0d-46a5-8162-7201b4277653", "tag": "3b2c5b8a-cb44-484c-9531-c39f763ffef9"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:00:02.718761 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-c3bf7755-4498-490e-8506-10051b282ea5 req-5963228d-a365-44d9-ba0c-bf835d99ce50 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:02.719295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-c3bf7755-4498-490e-8506-10051b282ea5 req-5963228d-a365-44d9-ba0c-bf835d99ce50 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:02.719703 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-c3bf7755-4498-490e-8506-10051b282ea5 req-5963228d-a365-44d9-ba0c-bf835d99ce50 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:02.732828 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-c3bf7755-4498-490e-8506-10051b282ea5 req-5963228d-a365-44d9-ba0c-bf835d99ce50 service nova] Creating event network-changed:3b2c5b8a-cb44-484c-9531-c39f763ffef9 for instance 842d5015-aa0d-46a5-8162-7201b4277653 on hv-cinder-85144 Aug 26 16:00:02.739268 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-c3bf7755-4498-490e-8506-10051b282ea5 req-5963228d-a365-44d9-ba0c-bf835d99ce50 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038422 Aug 26 16:00:02.740203 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 260/518] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:00:02.922408 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-915dd49d-d6df-4b90-92c6-467ef136d9d1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:02.923031 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-915dd49d-d6df-4b90-92c6-467ef136d9d1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:02.929180 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-915dd49d-d6df-4b90-92c6-467ef136d9d1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:02.929656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-915dd49d-d6df-4b90-92c6-467ef136d9d1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:02.930112 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-915dd49d-d6df-4b90-92c6-467ef136d9d1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:02.930763 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-915dd49d-d6df-4b90-92c6-467ef136d9d1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:02.931230 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-915dd49d-d6df-4b90-92c6-467ef136d9d1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:02.931648 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-915dd49d-d6df-4b90-92c6-467ef136d9d1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:03.114470 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-915dd49d-d6df-4b90-92c6-467ef136d9d1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:03.127508 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-915dd49d-d6df-4b90-92c6-467ef136d9d1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:03.129679 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-915dd49d-d6df-4b90-92c6-467ef136d9d1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:03.130867 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-915dd49d-d6df-4b90-92c6-467ef136d9d1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1752 microversion: 2.20 time: 0.213126 Aug 26 16:00:03.132242 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 261/519] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:02 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1752 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:00:03.138242 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-4af8e1bf-2d53-4472-ae31-f644a07db174 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:03.139275 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-4af8e1bf-2d53-4472-ae31-f644a07db174 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:03.152345 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4af8e1bf-2d53-4472-ae31-f644a07db174 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:03.152980 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4af8e1bf-2d53-4472-ae31-f644a07db174 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:03.153678 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4af8e1bf-2d53-4472-ae31-f644a07db174 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:03.154684 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4af8e1bf-2d53-4472-ae31-f644a07db174 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:03.155261 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4af8e1bf-2d53-4472-ae31-f644a07db174 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:03.156143 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4af8e1bf-2d53-4472-ae31-f644a07db174 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:03.176457 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-8a0bfb80-08d1-40d6-9fc1-5280c07e2ba2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "DELETE /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818" status: 204 len: 0 microversion: 2.1 time: 0.570189 Aug 26 16:00:03.177753 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 259/520] 10.222.0.94 () {58 vars in 1239 bytes} [Fri Aug 26 16:00:02 2022] DELETE /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 16:00:03.193269 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-61c9db9c-28a2-484a-bf1d-3e98791ce517 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:03.194440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-61c9db9c-28a2-484a-bf1d-3e98791ce517 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 98316258-36ac-4e26-b92d-48fc237b5818] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:03.201729 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-61c9db9c-28a2-484a-bf1d-3e98791ce517 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:03.202571 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-61c9db9c-28a2-484a-bf1d-3e98791ce517 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:03.203301 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-61c9db9c-28a2-484a-bf1d-3e98791ce517 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:03.204225 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-61c9db9c-28a2-484a-bf1d-3e98791ce517 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:03.204882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-61c9db9c-28a2-484a-bf1d-3e98791ce517 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:03.205507 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-61c9db9c-28a2-484a-bf1d-3e98791ce517 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:03.504006 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-4af8e1bf-2d53-4472-ae31-f644a07db174 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:03.514189 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-4af8e1bf-2d53-4472-ae31-f644a07db174 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1714 microversion: 2.1 time: 0.380752 Aug 26 16:00:03.527370 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 262/521] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:03 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1714 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:03.534032 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-3efe998d-373d-49e7-b2d6-04aac089bdb2 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:03.537980 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-61c9db9c-28a2-484a-bf1d-3e98791ce517 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:03.542483 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-3efe998d-373d-49e7-b2d6-04aac089bdb2 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:03.545670 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:00:03.547501 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-61c9db9c-28a2-484a-bf1d-3e98791ce517 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818" status: 200 len: 1512 microversion: 2.1 time: 0.357916 Aug 26 16:00:03.548292 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 260/522] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:03 2022] GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818 => generated 1512 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:03.557469 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3efe998d-373d-49e7-b2d6-04aac089bdb2 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:03.557469 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3efe998d-373d-49e7-b2d6-04aac089bdb2 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:03.557469 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3efe998d-373d-49e7-b2d6-04aac089bdb2 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:03.557469 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3efe998d-373d-49e7-b2d6-04aac089bdb2 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:03.557873 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3efe998d-373d-49e7-b2d6-04aac089bdb2 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:03.557873 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3efe998d-373d-49e7-b2d6-04aac089bdb2 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:03.714158 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-3efe998d-373d-49e7-b2d6-04aac089bdb2 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:03.724498 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-3efe998d-373d-49e7-b2d6-04aac089bdb2 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1313 microversion: 2.1 time: 0.193944 Aug 26 16:00:03.726200 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 263/523] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:03 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:04.161997 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-99229213-52ea-4152-9ba6-73ffbdb07dbd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:04.162610 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-99229213-52ea-4152-9ba6-73ffbdb07dbd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:04.169574 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-99229213-52ea-4152-9ba6-73ffbdb07dbd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:04.170076 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-99229213-52ea-4152-9ba6-73ffbdb07dbd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:04.170484 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-99229213-52ea-4152-9ba6-73ffbdb07dbd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:04.171545 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-99229213-52ea-4152-9ba6-73ffbdb07dbd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:04.171860 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-99229213-52ea-4152-9ba6-73ffbdb07dbd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:04.172283 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-99229213-52ea-4152-9ba6-73ffbdb07dbd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:04.319867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-99229213-52ea-4152-9ba6-73ffbdb07dbd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:04.332060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-99229213-52ea-4152-9ba6-73ffbdb07dbd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:04.336481 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-99229213-52ea-4152-9ba6-73ffbdb07dbd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:04.336481 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-99229213-52ea-4152-9ba6-73ffbdb07dbd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1754 microversion: 2.20 time: 0.176724 Aug 26 16:00:04.336481 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 261/524] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:04 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:04.570478 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-4fce634d-d42c-4dd3-89da-b45ca822859f tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:04.571168 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-4fce634d-d42c-4dd3-89da-b45ca822859f tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 98316258-36ac-4e26-b92d-48fc237b5818] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:04.581213 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4fce634d-d42c-4dd3-89da-b45ca822859f tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:04.581723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4fce634d-d42c-4dd3-89da-b45ca822859f tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:04.582135 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4fce634d-d42c-4dd3-89da-b45ca822859f tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:04.582841 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4fce634d-d42c-4dd3-89da-b45ca822859f tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:04.583389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4fce634d-d42c-4dd3-89da-b45ca822859f tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:04.583821 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4fce634d-d42c-4dd3-89da-b45ca822859f tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:04.725339 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-4fce634d-d42c-4dd3-89da-b45ca822859f tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:04.733947 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-4fce634d-d42c-4dd3-89da-b45ca822859f tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818" status: 200 len: 1512 microversion: 2.1 time: 0.167920 Aug 26 16:00:04.734520 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 264/525] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:04 2022] GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818 => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:04.744012 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-82e2775f-0780-4093-93d3-a5b038007a51 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:04.745067 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-82e2775f-0780-4093-93d3-a5b038007a51 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:04.752484 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-82e2775f-0780-4093-93d3-a5b038007a51 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:04.752986 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-82e2775f-0780-4093-93d3-a5b038007a51 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:04.753426 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-82e2775f-0780-4093-93d3-a5b038007a51 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:04.753603 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-2c274976-669e-4ebc-9380-4ac714ff93a5 req-3e8a0300-b092-473c-9d34-4419a991f494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a303bb17-edbe-4802-9ddb-de27baaa162a", "tag": "04480c9a-afaf-4f05-a159-cbd8adaaf019"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:00:04.754137 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-82e2775f-0780-4093-93d3-a5b038007a51 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:04.754597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-82e2775f-0780-4093-93d3-a5b038007a51 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:04.755426 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-82e2775f-0780-4093-93d3-a5b038007a51 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:04.763089 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-2c274976-669e-4ebc-9380-4ac714ff93a5 req-3e8a0300-b092-473c-9d34-4419a991f494 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:04.763579 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-2c274976-669e-4ebc-9380-4ac714ff93a5 req-3e8a0300-b092-473c-9d34-4419a991f494 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:04.764003 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-2c274976-669e-4ebc-9380-4ac714ff93a5 req-3e8a0300-b092-473c-9d34-4419a991f494 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:04.776839 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-2c274976-669e-4ebc-9380-4ac714ff93a5 req-3e8a0300-b092-473c-9d34-4419a991f494 service nova] Creating event network-changed:04480c9a-afaf-4f05-a159-cbd8adaaf019 for instance a303bb17-edbe-4802-9ddb-de27baaa162a on hv-cinder-85144 Aug 26 16:00:04.781675 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-2c274976-669e-4ebc-9380-4ac714ff93a5 req-3e8a0300-b092-473c-9d34-4419a991f494 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031615 Aug 26 16:00:04.782336 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 265/526] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:00:04.897784 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-82e2775f-0780-4093-93d3-a5b038007a51 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:04.900862 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:00:04.907170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-82e2775f-0780-4093-93d3-a5b038007a51 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1313 microversion: 2.1 time: 0.166864 Aug 26 16:00:04.907739 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 262/527] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:04 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:05.360122 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-c282bae6-50a1-4809-8640-02462d0cb48e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:05.361176 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-c282bae6-50a1-4809-8640-02462d0cb48e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:05.368313 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c282bae6-50a1-4809-8640-02462d0cb48e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:05.368836 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c282bae6-50a1-4809-8640-02462d0cb48e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:05.369340 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c282bae6-50a1-4809-8640-02462d0cb48e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:05.370235 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c282bae6-50a1-4809-8640-02462d0cb48e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:05.370724 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c282bae6-50a1-4809-8640-02462d0cb48e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:05.371301 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c282bae6-50a1-4809-8640-02462d0cb48e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:05.553645 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-c282bae6-50a1-4809-8640-02462d0cb48e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:05.564706 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-c282bae6-50a1-4809-8640-02462d0cb48e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:05.566190 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-c282bae6-50a1-4809-8640-02462d0cb48e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:05.570183 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-c282bae6-50a1-4809-8640-02462d0cb48e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1754 microversion: 2.20 time: 0.211636 Aug 26 16:00:05.570183 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 266/528] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:05 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1754 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:05.756295 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-24541e97-241b-4862-b97f-557ff177a913 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:05.757576 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-24541e97-241b-4862-b97f-557ff177a913 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 98316258-36ac-4e26-b92d-48fc237b5818] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:05.774349 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-24541e97-241b-4862-b97f-557ff177a913 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:05.775390 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-24541e97-241b-4862-b97f-557ff177a913 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:05.776008 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-24541e97-241b-4862-b97f-557ff177a913 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:05.777436 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-24541e97-241b-4862-b97f-557ff177a913 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:05.779486 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-24541e97-241b-4862-b97f-557ff177a913 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:05.783341 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-24541e97-241b-4862-b97f-557ff177a913 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:05.929930 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-d5356a1e-ec80-4cb4-afca-d8e8823492c8 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:05.931819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-d5356a1e-ec80-4cb4-afca-d8e8823492c8 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:05.939981 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d5356a1e-ec80-4cb4-afca-d8e8823492c8 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:05.940569 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d5356a1e-ec80-4cb4-afca-d8e8823492c8 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:05.941699 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d5356a1e-ec80-4cb4-afca-d8e8823492c8 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:05.942484 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d5356a1e-ec80-4cb4-afca-d8e8823492c8 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:05.943041 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d5356a1e-ec80-4cb4-afca-d8e8823492c8 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:05.943593 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d5356a1e-ec80-4cb4-afca-d8e8823492c8 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:06.119831 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-24541e97-241b-4862-b97f-557ff177a913 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:06.129439 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-24541e97-241b-4862-b97f-557ff177a913 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818" status: 200 len: 1512 microversion: 2.1 time: 0.377360 Aug 26 16:00:06.131943 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 263/529] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:05 2022] GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818 => generated 1512 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:06.209180 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d5356a1e-ec80-4cb4-afca-d8e8823492c8 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:06.222785 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-d5356a1e-ec80-4cb4-afca-d8e8823492c8 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1313 microversion: 2.1 time: 0.296338 Aug 26 16:00:06.224540 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 267/530] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:05 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:00:06.591445 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-0eecab14-8f77-40a8-a334-5ccb7fd32d2c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:06.592067 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-0eecab14-8f77-40a8-a334-5ccb7fd32d2c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:06.598596 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0eecab14-8f77-40a8-a334-5ccb7fd32d2c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:06.609270 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0eecab14-8f77-40a8-a334-5ccb7fd32d2c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:06.609270 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0eecab14-8f77-40a8-a334-5ccb7fd32d2c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:06.609270 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0eecab14-8f77-40a8-a334-5ccb7fd32d2c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:06.609270 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0eecab14-8f77-40a8-a334-5ccb7fd32d2c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:06.609673 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0eecab14-8f77-40a8-a334-5ccb7fd32d2c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:06.747600 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-0eecab14-8f77-40a8-a334-5ccb7fd32d2c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:06.756884 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-0eecab14-8f77-40a8-a334-5ccb7fd32d2c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:06.758451 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-0eecab14-8f77-40a8-a334-5ccb7fd32d2c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:06.759720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-0eecab14-8f77-40a8-a334-5ccb7fd32d2c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1754 microversion: 2.20 time: 0.172708 Aug 26 16:00:06.760271 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 264/531] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:06 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:00:06.796641 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-4e64f9ea-44da-4ba7-acdc-6b1171c0402e req-d24c9e9b-6cb2-4fb6-a91c-3e9002184961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98316258-36ac-4e26-b92d-48fc237b5818", "name": "network-vif-deleted", "tag": "e7d4227b-1c33-41ac-a99b-20b0fcfca9cc"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:00:06.806814 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-4e64f9ea-44da-4ba7-acdc-6b1171c0402e req-d24c9e9b-6cb2-4fb6-a91c-3e9002184961 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:06.807352 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-4e64f9ea-44da-4ba7-acdc-6b1171c0402e req-d24c9e9b-6cb2-4fb6-a91c-3e9002184961 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:06.807803 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-4e64f9ea-44da-4ba7-acdc-6b1171c0402e req-d24c9e9b-6cb2-4fb6-a91c-3e9002184961 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:06.818835 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-4e64f9ea-44da-4ba7-acdc-6b1171c0402e req-d24c9e9b-6cb2-4fb6-a91c-3e9002184961 service nova] Creating event network-vif-deleted:e7d4227b-1c33-41ac-a99b-20b0fcfca9cc for instance 98316258-36ac-4e26-b92d-48fc237b5818 on hv-cinder-85144 Aug 26 16:00:06.826534 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-4e64f9ea-44da-4ba7-acdc-6b1171c0402e req-d24c9e9b-6cb2-4fb6-a91c-3e9002184961 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033622 Aug 26 16:00:06.829094 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 268/532] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:00:07.155080 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-793fc008-9deb-4348-bb6c-f26be6f3fc20 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:07.155769 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-793fc008-9deb-4348-bb6c-f26be6f3fc20 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 98316258-36ac-4e26-b92d-48fc237b5818] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:07.164380 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-793fc008-9deb-4348-bb6c-f26be6f3fc20 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:07.165245 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-793fc008-9deb-4348-bb6c-f26be6f3fc20 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:07.166063 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-793fc008-9deb-4348-bb6c-f26be6f3fc20 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:07.167323 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-793fc008-9deb-4348-bb6c-f26be6f3fc20 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:07.168147 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-793fc008-9deb-4348-bb6c-f26be6f3fc20 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:07.169458 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-793fc008-9deb-4348-bb6c-f26be6f3fc20 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:07.251052 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-e3a74a2a-1c72-40da-acfa-fb6f882398ce tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:07.251950 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-e3a74a2a-1c72-40da-acfa-fb6f882398ce tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:07.258596 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e3a74a2a-1c72-40da-acfa-fb6f882398ce tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:07.259151 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e3a74a2a-1c72-40da-acfa-fb6f882398ce tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:07.259593 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e3a74a2a-1c72-40da-acfa-fb6f882398ce tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:07.260448 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e3a74a2a-1c72-40da-acfa-fb6f882398ce tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:07.261076 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e3a74a2a-1c72-40da-acfa-fb6f882398ce tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:07.261675 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e3a74a2a-1c72-40da-acfa-fb6f882398ce tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:07.321988 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-793fc008-9deb-4348-bb6c-f26be6f3fc20 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:07.339785 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-793fc008-9deb-4348-bb6c-f26be6f3fc20 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818" status: 200 len: 1470 microversion: 2.1 time: 0.188611 Aug 26 16:00:07.340383 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 265/533] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:07 2022] GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818 => generated 1470 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:07.784002 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-42bc84fb-a49c-41e2-9a5f-6b3018556f72 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:07.784690 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-42bc84fb-a49c-41e2-9a5f-6b3018556f72 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:07.790793 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42bc84fb-a49c-41e2-9a5f-6b3018556f72 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:07.791403 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42bc84fb-a49c-41e2-9a5f-6b3018556f72 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:07.791845 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42bc84fb-a49c-41e2-9a5f-6b3018556f72 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:07.792748 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42bc84fb-a49c-41e2-9a5f-6b3018556f72 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:07.793222 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42bc84fb-a49c-41e2-9a5f-6b3018556f72 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:07.793798 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42bc84fb-a49c-41e2-9a5f-6b3018556f72 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:07.842049 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-e3a74a2a-1c72-40da-acfa-fb6f882398ce tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:07.850457 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-e3a74a2a-1c72-40da-acfa-fb6f882398ce tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1313 microversion: 2.1 time: 0.607146 Aug 26 16:00:07.851069 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 269/534] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:07 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1313 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:00:08.017086 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-42bc84fb-a49c-41e2-9a5f-6b3018556f72 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:08.026809 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-42bc84fb-a49c-41e2-9a5f-6b3018556f72 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:08.028512 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-42bc84fb-a49c-41e2-9a5f-6b3018556f72 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:08.029906 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-42bc84fb-a49c-41e2-9a5f-6b3018556f72 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1754 microversion: 2.20 time: 0.250127 Aug 26 16:00:08.036639 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 266/535] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:07 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1754 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:08.361666 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-d2b93966-05ad-4426-8298-95b17594fdaf tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:08.362270 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-d2b93966-05ad-4426-8298-95b17594fdaf tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 98316258-36ac-4e26-b92d-48fc237b5818] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:08.368721 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d2b93966-05ad-4426-8298-95b17594fdaf tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:08.369195 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d2b93966-05ad-4426-8298-95b17594fdaf tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:08.369627 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d2b93966-05ad-4426-8298-95b17594fdaf tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:08.370298 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d2b93966-05ad-4426-8298-95b17594fdaf tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:08.370741 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d2b93966-05ad-4426-8298-95b17594fdaf tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:08.371187 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d2b93966-05ad-4426-8298-95b17594fdaf tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:08.402162 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d2b93966-05ad-4426-8298-95b17594fdaf tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:08.402638 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d2b93966-05ad-4426-8298-95b17594fdaf tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:08.403088 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d2b93966-05ad-4426-8298-95b17594fdaf tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:08.404270 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-d2b93966-05ad-4426-8298-95b17594fdaf tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lazy-loading 'fault' on Instance uuid 98316258-36ac-4e26-b92d-48fc237b5818 {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:00:08.445578 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d2b93966-05ad-4426-8298-95b17594fdaf tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:08.454450 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-d2b93966-05ad-4426-8298-95b17594fdaf tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818" status: 200 len: 1308 microversion: 2.1 time: 0.096598 Aug 26 16:00:08.455026 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 270/536] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:08 2022] GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818 => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:08.874452 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-dbef74cd-829f-49cd-bca8-cdc9dc76199a tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:08.875345 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-dbef74cd-829f-49cd-bca8-cdc9dc76199a tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:08.881815 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-dbef74cd-829f-49cd-bca8-cdc9dc76199a tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:08.882258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-dbef74cd-829f-49cd-bca8-cdc9dc76199a tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:08.882690 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-dbef74cd-829f-49cd-bca8-cdc9dc76199a tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:08.883683 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-dbef74cd-829f-49cd-bca8-cdc9dc76199a tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:08.884419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-dbef74cd-829f-49cd-bca8-cdc9dc76199a tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:08.884854 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-dbef74cd-829f-49cd-bca8-cdc9dc76199a tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:09.018948 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-dbef74cd-829f-49cd-bca8-cdc9dc76199a tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:09.027657 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-dbef74cd-829f-49cd-bca8-cdc9dc76199a tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1313 microversion: 2.1 time: 0.159653 Aug 26 16:00:09.034309 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 267/537] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:08 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:09.053651 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-c1a7d9e8-ca3e-49ef-991c-5fc34b25307c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:09.054260 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-c1a7d9e8-ca3e-49ef-991c-5fc34b25307c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:09.060732 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c1a7d9e8-ca3e-49ef-991c-5fc34b25307c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:09.063210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c1a7d9e8-ca3e-49ef-991c-5fc34b25307c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:09.063210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c1a7d9e8-ca3e-49ef-991c-5fc34b25307c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:09.063210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c1a7d9e8-ca3e-49ef-991c-5fc34b25307c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:09.063210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c1a7d9e8-ca3e-49ef-991c-5fc34b25307c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:09.063894 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c1a7d9e8-ca3e-49ef-991c-5fc34b25307c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:09.201557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-c1a7d9e8-ca3e-49ef-991c-5fc34b25307c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:09.210763 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-c1a7d9e8-ca3e-49ef-991c-5fc34b25307c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:09.212223 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-c1a7d9e8-ca3e-49ef-991c-5fc34b25307c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:09.213377 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-c1a7d9e8-ca3e-49ef-991c-5fc34b25307c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1810 microversion: 2.20 time: 0.163721 Aug 26 16:00:09.213937 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 271/538] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:09 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:09.476700 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-5a3c3483-edf2-4211-a123-b2e85e8ee2e2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:09.477318 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-5a3c3483-edf2-4211-a123-b2e85e8ee2e2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 98316258-36ac-4e26-b92d-48fc237b5818] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:09.483372 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5a3c3483-edf2-4211-a123-b2e85e8ee2e2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:09.483865 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5a3c3483-edf2-4211-a123-b2e85e8ee2e2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:09.484638 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5a3c3483-edf2-4211-a123-b2e85e8ee2e2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:09.485349 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5a3c3483-edf2-4211-a123-b2e85e8ee2e2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:09.485801 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5a3c3483-edf2-4211-a123-b2e85e8ee2e2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:09.486235 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5a3c3483-edf2-4211-a123-b2e85e8ee2e2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:09.500395 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-5a3c3483-edf2-4211-a123-b2e85e8ee2e2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] HTTP exception thrown: Instance 98316258-36ac-4e26-b92d-48fc237b5818 could not be found. Aug 26 16:00:09.502490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-5a3c3483-edf2-4211-a123-b2e85e8ee2e2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Request method failure captured: Aug 26 16:00:09.502490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818 HTTP/1.1 Aug 26 16:00:09.502490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 16:00:09.502490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 16:00:09.502490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 16:00:09.502490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 0 Aug 26 16:00:09.502490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 16:00:09.502490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 16:00:09.502490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 16:00:09.502490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 16:00:09.502490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO2bvQquYx-QX9opNL3-SuDBzWubsZ7aYjlAcGjZhJmncuoj2SPrDL-rg88gtwHZXEvLy78CnCsRedQbRhOjYj-SqTvrv7vdI5JGn1h9gtzgFFf-QDCRWGPW-hRE0tWN_xLit_qUDPyNo6XcjlkqVrQc5SpCcJ0L1lqTy-4-vjl4Bno Aug 26 16:00:09.502490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 16:00:09.502490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 16:00:09.502490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 16:00:09.502490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 16:00:09.502490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 16:00:09.502490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 16:00:09.502490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: f3a9b259e9d54603af734306adbfe16c Aug 26 16:00:09.502490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1260948601 Aug 26 16:00:09.502490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 16:00:09.502490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 16:00:09.504047 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/f3a9b259e9d54603af734306adbfe16c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/f3a9b259e9d54603af734306adbfe16c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/f3a9b259e9d54603af734306adbfe16c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_f3a9b259e9d54603af734306adbfe16c", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:00:09.504047 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-VolumesSnapshotTestJSON-1260948601 Aug 26 16:00:09.504047 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: f3a9b259e9d54603af734306adbfe16c Aug 26 16:00:09.504047 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1260948601 Aug 26 16:00:09.504047 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-VolumesSnapshotTestJSON-1260948601-project Aug 26 16:00:09.504047 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 16:00:09.504047 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 16:00:09.504047 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: a0ecfd3d64ba4fef820a31b1522125ff Aug 26 16:00:09.504047 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-VolumesSnapshotTestJSON-1260948601-project Aug 26 16:00:09.504047 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: > Aug 26 16:00:09.504047 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Instance 98316258-36ac-4e26-b92d-48fc237b5818 could not be found. Aug 26 16:00:09.504047 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'id': '98316258-36ac-4e26-b92d-48fc237b5818'} Aug 26 16:00:09.504934 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:00:09.504934 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:00:09.504934 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:00:09.504934 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:00:09.504934 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:00:09.504934 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:00:09.504934 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:00:09.504934 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:00:09.504934 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:00:09.504934 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:00:09.504934 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98316258-36ac-4e26-b92d-48fc237b5818 could not be found. Aug 26 16:00:09.504934 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:00:09.504934 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:00:09.504934 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:00:09.504934 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:00:09.504934 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:00:09.504934 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:00:09.504934 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:00:09.504934 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:00:09.504934 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:00:09.506438 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:00:09.506438 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:00:09.506438 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:00:09.506438 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:00:09.506438 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:00:09.506438 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:00:09.506438 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:00:09.506438 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98316258-36ac-4e26-b92d-48fc237b5818 could not be found. Aug 26 16:00:09.506438 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:00:09.506438 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:00:09.506438 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:00:09.506438 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:00:09.506438 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:00:09.506438 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:00:09.506438 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:00:09.506438 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:00:09.506438 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98316258-36ac-4e26-b92d-48fc237b5818 could not be found. Aug 26 16:00:09.506438 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:00:09.507808 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-5a3c3483-edf2-4211-a123-b2e85e8ee2e2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Returning 404 to user: Instance 98316258-36ac-4e26-b92d-48fc237b5818 could not be found. {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:00:09.507808 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-5a3c3483-edf2-4211-a123-b2e85e8ee2e2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818" status: 404 len: 111 microversion: 2.1 time: 0.031459 Aug 26 16:00:09.507953 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 268/539] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:09 2022] GET /compute/v2.1/servers/98316258-36ac-4e26-b92d-48fc237b5818 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:00:10.049714 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-493d385b-ead1-4ed1-b522-39f9da4d0084 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:10.050689 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-493d385b-ead1-4ed1-b522-39f9da4d0084 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:10.061890 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-493d385b-ead1-4ed1-b522-39f9da4d0084 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:10.061890 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-493d385b-ead1-4ed1-b522-39f9da4d0084 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:10.061890 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-493d385b-ead1-4ed1-b522-39f9da4d0084 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:10.062455 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-493d385b-ead1-4ed1-b522-39f9da4d0084 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:10.062884 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-493d385b-ead1-4ed1-b522-39f9da4d0084 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:10.063357 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-493d385b-ead1-4ed1-b522-39f9da4d0084 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:10.208790 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-493d385b-ead1-4ed1-b522-39f9da4d0084 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:10.216394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-493d385b-ead1-4ed1-b522-39f9da4d0084 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1313 microversion: 2.1 time: 0.170801 Aug 26 16:00:10.219515 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 272/540] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:10 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:10.237762 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7d1a13b8-6316-4d3e-8570-f910a277f399 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:10.238475 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-7d1a13b8-6316-4d3e-8570-f910a277f399 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:10.245950 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7d1a13b8-6316-4d3e-8570-f910a277f399 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:10.246868 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7d1a13b8-6316-4d3e-8570-f910a277f399 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:10.248003 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7d1a13b8-6316-4d3e-8570-f910a277f399 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:10.249716 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7d1a13b8-6316-4d3e-8570-f910a277f399 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:10.250399 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7d1a13b8-6316-4d3e-8570-f910a277f399 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:10.250890 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7d1a13b8-6316-4d3e-8570-f910a277f399 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:10.391840 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7d1a13b8-6316-4d3e-8570-f910a277f399 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:10.424298 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7d1a13b8-6316-4d3e-8570-f910a277f399 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:10.424298 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7d1a13b8-6316-4d3e-8570-f910a277f399 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:10.424298 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-7d1a13b8-6316-4d3e-8570-f910a277f399 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1810 microversion: 2.20 time: 0.176332 Aug 26 16:00:10.424629 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 269/541] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:10 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:11.243786 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-15036ca6-ecbc-46c9-889e-d2f69778a71f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:11.244397 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-15036ca6-ecbc-46c9-889e-d2f69778a71f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:11.250867 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-15036ca6-ecbc-46c9-889e-d2f69778a71f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:11.251384 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-15036ca6-ecbc-46c9-889e-d2f69778a71f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:11.251818 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-15036ca6-ecbc-46c9-889e-d2f69778a71f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:11.252541 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-15036ca6-ecbc-46c9-889e-d2f69778a71f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:11.252993 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-15036ca6-ecbc-46c9-889e-d2f69778a71f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:11.253416 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-15036ca6-ecbc-46c9-889e-d2f69778a71f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:11.273949 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=100 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:00:11.388224 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-15036ca6-ecbc-46c9-889e-d2f69778a71f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:11.396145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-15036ca6-ecbc-46c9-889e-d2f69778a71f tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1313 microversion: 2.1 time: 0.156337 Aug 26 16:00:11.396712 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 273/542] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:11 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:11.433627 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-0c7bf88b-6bd1-4041-9ef8-de1624ea7e47 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:11.434258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-0c7bf88b-6bd1-4041-9ef8-de1624ea7e47 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:11.440840 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0c7bf88b-6bd1-4041-9ef8-de1624ea7e47 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:11.441313 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0c7bf88b-6bd1-4041-9ef8-de1624ea7e47 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:11.441743 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0c7bf88b-6bd1-4041-9ef8-de1624ea7e47 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:11.442428 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0c7bf88b-6bd1-4041-9ef8-de1624ea7e47 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:11.442871 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0c7bf88b-6bd1-4041-9ef8-de1624ea7e47 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:11.443346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0c7bf88b-6bd1-4041-9ef8-de1624ea7e47 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:11.583950 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-0c7bf88b-6bd1-4041-9ef8-de1624ea7e47 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:11.593129 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-0c7bf88b-6bd1-4041-9ef8-de1624ea7e47 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:11.594541 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-0c7bf88b-6bd1-4041-9ef8-de1624ea7e47 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:11.595712 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-0c7bf88b-6bd1-4041-9ef8-de1624ea7e47 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1810 microversion: 2.20 time: 0.166067 Aug 26 16:00:11.596265 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 270/543] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:11 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:12.506029 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-da79abaa-ccf2-4f23-8695-1d9ac01c1e70 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:12.506029 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-da79abaa-ccf2-4f23-8695-1d9ac01c1e70 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:12.506029 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-da79abaa-ccf2-4f23-8695-1d9ac01c1e70 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:12.506029 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-da79abaa-ccf2-4f23-8695-1d9ac01c1e70 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:12.506819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-da79abaa-ccf2-4f23-8695-1d9ac01c1e70 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:12.506819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-da79abaa-ccf2-4f23-8695-1d9ac01c1e70 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:12.506819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-da79abaa-ccf2-4f23-8695-1d9ac01c1e70 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:12.506819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-da79abaa-ccf2-4f23-8695-1d9ac01c1e70 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:12.611982 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-da79abaa-ccf2-4f23-8695-1d9ac01c1e70 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:12.619143 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-0ef437c4-c71b-48e9-beea-64052f9b9403 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:12.620361 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-0ef437c4-c71b-48e9-beea-64052f9b9403 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:12.621178 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-da79abaa-ccf2-4f23-8695-1d9ac01c1e70 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1313 microversion: 2.1 time: 0.207223 Aug 26 16:00:12.621758 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 274/544] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:12 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:12.628077 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0ef437c4-c71b-48e9-beea-64052f9b9403 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:12.628559 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0ef437c4-c71b-48e9-beea-64052f9b9403 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:12.628992 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0ef437c4-c71b-48e9-beea-64052f9b9403 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:12.629688 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0ef437c4-c71b-48e9-beea-64052f9b9403 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:12.630317 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0ef437c4-c71b-48e9-beea-64052f9b9403 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:12.630738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0ef437c4-c71b-48e9-beea-64052f9b9403 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:12.802539 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-0ef437c4-c71b-48e9-beea-64052f9b9403 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:12.815997 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-0ef437c4-c71b-48e9-beea-64052f9b9403 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:12.817757 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-0ef437c4-c71b-48e9-beea-64052f9b9403 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:12.819168 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-0ef437c4-c71b-48e9-beea-64052f9b9403 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1810 microversion: 2.20 time: 0.204350 Aug 26 16:00:12.839776 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 271/545] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:12 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1810 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:00:13.643304 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-4be52ad8-0a57-4df5-b4d7-fb580acfa8fd tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:13.643982 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-4be52ad8-0a57-4df5-b4d7-fb580acfa8fd tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:13.650504 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4be52ad8-0a57-4df5-b4d7-fb580acfa8fd tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:13.651012 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4be52ad8-0a57-4df5-b4d7-fb580acfa8fd tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:13.651635 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4be52ad8-0a57-4df5-b4d7-fb580acfa8fd tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:13.652322 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4be52ad8-0a57-4df5-b4d7-fb580acfa8fd tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:13.652769 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4be52ad8-0a57-4df5-b4d7-fb580acfa8fd tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:13.653427 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4be52ad8-0a57-4df5-b4d7-fb580acfa8fd tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:13.791541 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-4be52ad8-0a57-4df5-b4d7-fb580acfa8fd tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:13.802057 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-4be52ad8-0a57-4df5-b4d7-fb580acfa8fd tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1313 microversion: 2.1 time: 0.162797 Aug 26 16:00:13.802638 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 275/546] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:13 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:13.846607 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-d3ce4a93-374e-4bf3-bf1c-629b8b906eed tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:13.848032 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-d3ce4a93-374e-4bf3-bf1c-629b8b906eed tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:13.856876 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d3ce4a93-374e-4bf3-bf1c-629b8b906eed tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:13.857482 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d3ce4a93-374e-4bf3-bf1c-629b8b906eed tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:13.858182 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d3ce4a93-374e-4bf3-bf1c-629b8b906eed tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:13.859132 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d3ce4a93-374e-4bf3-bf1c-629b8b906eed tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:13.859756 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d3ce4a93-374e-4bf3-bf1c-629b8b906eed tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:13.860185 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d3ce4a93-374e-4bf3-bf1c-629b8b906eed tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:14.012694 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-d3ce4a93-374e-4bf3-bf1c-629b8b906eed tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:14.022516 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-d3ce4a93-374e-4bf3-bf1c-629b8b906eed tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:14.024125 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-d3ce4a93-374e-4bf3-bf1c-629b8b906eed tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:14.025218 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-d3ce4a93-374e-4bf3-bf1c-629b8b906eed tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1810 microversion: 2.20 time: 0.182978 Aug 26 16:00:14.025776 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 272/547] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:13 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1810 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:14.825199 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-1a37e110-0353-4f95-ab4d-055d8316888b tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:14.825784 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-1a37e110-0353-4f95-ab4d-055d8316888b tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:14.834208 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1a37e110-0353-4f95-ab4d-055d8316888b tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:14.836027 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1a37e110-0353-4f95-ab4d-055d8316888b tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:14.836027 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1a37e110-0353-4f95-ab4d-055d8316888b tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:14.836027 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1a37e110-0353-4f95-ab4d-055d8316888b tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:14.836027 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1a37e110-0353-4f95-ab4d-055d8316888b tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:14.836544 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1a37e110-0353-4f95-ab4d-055d8316888b tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:15.009706 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-1a37e110-0353-4f95-ab4d-055d8316888b tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:15.026524 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-1a37e110-0353-4f95-ab4d-055d8316888b tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1313 microversion: 2.1 time: 0.205999 Aug 26 16:00:15.027169 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 276/548] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:14 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:15.049034 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-1b5321ce-9109-437d-a5fb-6673094ec4ff tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:15.103983 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-1b5321ce-9109-437d-a5fb-6673094ec4ff tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:15.103983 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1b5321ce-9109-437d-a5fb-6673094ec4ff tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:15.103983 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1b5321ce-9109-437d-a5fb-6673094ec4ff tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:15.103983 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1b5321ce-9109-437d-a5fb-6673094ec4ff tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:15.104544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1b5321ce-9109-437d-a5fb-6673094ec4ff tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:15.104544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1b5321ce-9109-437d-a5fb-6673094ec4ff tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:15.104544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1b5321ce-9109-437d-a5fb-6673094ec4ff tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:15.206873 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-1b5321ce-9109-437d-a5fb-6673094ec4ff tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:15.217217 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-1b5321ce-9109-437d-a5fb-6673094ec4ff tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:15.219137 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-1b5321ce-9109-437d-a5fb-6673094ec4ff tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:15.220573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-1b5321ce-9109-437d-a5fb-6673094ec4ff tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1810 microversion: 2.20 time: 0.175719 Aug 26 16:00:15.221139 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 273/549] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:15 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:16.048479 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-4070e738-400b-4db7-9eff-d15564c5e620 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:16.049330 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-4070e738-400b-4db7-9eff-d15564c5e620 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:16.056423 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4070e738-400b-4db7-9eff-d15564c5e620 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:16.057219 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4070e738-400b-4db7-9eff-d15564c5e620 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:16.057841 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4070e738-400b-4db7-9eff-d15564c5e620 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:16.058770 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4070e738-400b-4db7-9eff-d15564c5e620 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:16.060199 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4070e738-400b-4db7-9eff-d15564c5e620 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:16.061036 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4070e738-400b-4db7-9eff-d15564c5e620 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:16.254312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-55dbd6ec-3917-4d17-a0ab-c50e16c4ace6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:16.257690 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-55dbd6ec-3917-4d17-a0ab-c50e16c4ace6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:16.260074 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-4070e738-400b-4db7-9eff-d15564c5e620 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:16.263578 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-55dbd6ec-3917-4d17-a0ab-c50e16c4ace6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:16.264386 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-55dbd6ec-3917-4d17-a0ab-c50e16c4ace6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:16.265036 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-55dbd6ec-3917-4d17-a0ab-c50e16c4ace6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:16.265937 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-55dbd6ec-3917-4d17-a0ab-c50e16c4ace6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:16.266596 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-55dbd6ec-3917-4d17-a0ab-c50e16c4ace6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:16.267301 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-55dbd6ec-3917-4d17-a0ab-c50e16c4ace6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:16.291029 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-4070e738-400b-4db7-9eff-d15564c5e620 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1313 microversion: 2.1 time: 0.247353 Aug 26 16:00:16.297194 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 277/550] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:16 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:16.472395 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-55dbd6ec-3917-4d17-a0ab-c50e16c4ace6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:16.475190 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-232059a8-b166-4aa2-9f0c-d23c069c3b3f req-42f3ccea-4d8c-4511-a950-97c71055f8bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a303bb17-edbe-4802-9ddb-de27baaa162a", "name": "network-vif-plugged", "status": "completed", "tag": "04480c9a-afaf-4f05-a159-cbd8adaaf019"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:00:16.484091 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-55dbd6ec-3917-4d17-a0ab-c50e16c4ace6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:16.485567 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-55dbd6ec-3917-4d17-a0ab-c50e16c4ace6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:16.486740 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-55dbd6ec-3917-4d17-a0ab-c50e16c4ace6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1810 microversion: 2.20 time: 0.239981 Aug 26 16:00:16.487413 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-232059a8-b166-4aa2-9f0c-d23c069c3b3f req-42f3ccea-4d8c-4511-a950-97c71055f8bd service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:16.487582 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 274/551] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:16 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1810 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:16.488178 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-232059a8-b166-4aa2-9f0c-d23c069c3b3f req-42f3ccea-4d8c-4511-a950-97c71055f8bd service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:16.488699 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-232059a8-b166-4aa2-9f0c-d23c069c3b3f req-42f3ccea-4d8c-4511-a950-97c71055f8bd service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:16.504483 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-232059a8-b166-4aa2-9f0c-d23c069c3b3f req-42f3ccea-4d8c-4511-a950-97c71055f8bd service nova] Creating event network-vif-plugged:04480c9a-afaf-4f05-a159-cbd8adaaf019 for instance a303bb17-edbe-4802-9ddb-de27baaa162a on hv-cinder-85144 Aug 26 16:00:16.511756 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-232059a8-b166-4aa2-9f0c-d23c069c3b3f req-42f3ccea-4d8c-4511-a950-97c71055f8bd service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041569 Aug 26 16:00:16.513246 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 278/552] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:00:17.322021 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ba60a98c-9f26-48f0-861e-51a6385f4bc3 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:17.323360 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ba60a98c-9f26-48f0-861e-51a6385f4bc3 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:17.338765 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba60a98c-9f26-48f0-861e-51a6385f4bc3 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:17.338765 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba60a98c-9f26-48f0-861e-51a6385f4bc3 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:17.338765 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba60a98c-9f26-48f0-861e-51a6385f4bc3 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:17.343872 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba60a98c-9f26-48f0-861e-51a6385f4bc3 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:17.344372 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba60a98c-9f26-48f0-861e-51a6385f4bc3 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:17.344870 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba60a98c-9f26-48f0-861e-51a6385f4bc3 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:17.510851 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-ba60a98c-9f26-48f0-861e-51a6385f4bc3 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:17.517775 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-8ec43f2f-f44d-43e2-bf41-a1520eb8dac2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:17.518547 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-8ec43f2f-f44d-43e2-bf41-a1520eb8dac2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:17.521307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ba60a98c-9f26-48f0-861e-51a6385f4bc3 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1313 microversion: 2.1 time: 0.202978 Aug 26 16:00:17.521936 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 275/553] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:17 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:17.525340 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8ec43f2f-f44d-43e2-bf41-a1520eb8dac2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:17.525849 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8ec43f2f-f44d-43e2-bf41-a1520eb8dac2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:17.526288 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8ec43f2f-f44d-43e2-bf41-a1520eb8dac2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:17.527029 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8ec43f2f-f44d-43e2-bf41-a1520eb8dac2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:17.527634 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8ec43f2f-f44d-43e2-bf41-a1520eb8dac2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:17.528137 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8ec43f2f-f44d-43e2-bf41-a1520eb8dac2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:17.683355 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-8ec43f2f-f44d-43e2-bf41-a1520eb8dac2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:17.693286 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-8ec43f2f-f44d-43e2-bf41-a1520eb8dac2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:17.695118 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-8ec43f2f-f44d-43e2-bf41-a1520eb8dac2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:17.696076 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-8ec43f2f-f44d-43e2-bf41-a1520eb8dac2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1810 microversion: 2.20 time: 0.183706 Aug 26 16:00:17.697081 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 279/554] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:17 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1810 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:18.541648 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-d15fd039-25d3-4f20-97b2-a7970a8fb551 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:18.542981 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-d15fd039-25d3-4f20-97b2-a7970a8fb551 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:18.550145 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d15fd039-25d3-4f20-97b2-a7970a8fb551 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:18.550644 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d15fd039-25d3-4f20-97b2-a7970a8fb551 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:18.551108 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d15fd039-25d3-4f20-97b2-a7970a8fb551 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:18.551819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d15fd039-25d3-4f20-97b2-a7970a8fb551 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:18.552270 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d15fd039-25d3-4f20-97b2-a7970a8fb551 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:18.552692 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d15fd039-25d3-4f20-97b2-a7970a8fb551 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:18.732590 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-93e4bddc-54b0-4ffd-8a92-58fd6789b0e4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:18.733199 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-93e4bddc-54b0-4ffd-8a92-58fd6789b0e4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:18.740492 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-d15fd039-25d3-4f20-97b2-a7970a8fb551 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:18.744215 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-93e4bddc-54b0-4ffd-8a92-58fd6789b0e4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:18.744714 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-93e4bddc-54b0-4ffd-8a92-58fd6789b0e4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:18.745152 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-93e4bddc-54b0-4ffd-8a92-58fd6789b0e4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:18.745869 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-93e4bddc-54b0-4ffd-8a92-58fd6789b0e4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:18.746322 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-93e4bddc-54b0-4ffd-8a92-58fd6789b0e4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:18.749751 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-d15fd039-25d3-4f20-97b2-a7970a8fb551 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1313 microversion: 2.1 time: 0.211950 Aug 26 16:00:18.751339 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 276/555] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:18 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:18.761628 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-93e4bddc-54b0-4ffd-8a92-58fd6789b0e4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:18.902301 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-93e4bddc-54b0-4ffd-8a92-58fd6789b0e4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:18.917584 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-93e4bddc-54b0-4ffd-8a92-58fd6789b0e4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:18.929045 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-93e4bddc-54b0-4ffd-8a92-58fd6789b0e4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:18.930306 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-93e4bddc-54b0-4ffd-8a92-58fd6789b0e4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1810 microversion: 2.20 time: 0.202763 Aug 26 16:00:18.935215 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 280/556] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:18 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1810 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:00:19.776577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-bcfed2ae-37ff-4402-825c-fdb6911caf26 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:19.777659 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-bcfed2ae-37ff-4402-825c-fdb6911caf26 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:19.785269 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bcfed2ae-37ff-4402-825c-fdb6911caf26 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:19.785942 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bcfed2ae-37ff-4402-825c-fdb6911caf26 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:19.786444 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bcfed2ae-37ff-4402-825c-fdb6911caf26 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:19.787171 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bcfed2ae-37ff-4402-825c-fdb6911caf26 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:19.787622 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bcfed2ae-37ff-4402-825c-fdb6911caf26 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:19.788043 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bcfed2ae-37ff-4402-825c-fdb6911caf26 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:19.931393 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-bcfed2ae-37ff-4402-825c-fdb6911caf26 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:19.940259 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-bcfed2ae-37ff-4402-825c-fdb6911caf26 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1313 microversion: 2.1 time: 0.168285 Aug 26 16:00:19.945374 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 277/557] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:19 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:19.954223 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-6484e78b-6caf-44f5-9938-0d0c479fc19c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:19.954861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-6484e78b-6caf-44f5-9938-0d0c479fc19c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:19.961522 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6484e78b-6caf-44f5-9938-0d0c479fc19c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:19.962050 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6484e78b-6caf-44f5-9938-0d0c479fc19c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:19.962549 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6484e78b-6caf-44f5-9938-0d0c479fc19c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:19.963263 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6484e78b-6caf-44f5-9938-0d0c479fc19c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:19.963746 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6484e78b-6caf-44f5-9938-0d0c479fc19c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:19.964213 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6484e78b-6caf-44f5-9938-0d0c479fc19c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:20.114260 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-6484e78b-6caf-44f5-9938-0d0c479fc19c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:20.151687 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-6484e78b-6caf-44f5-9938-0d0c479fc19c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:20.151687 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-6484e78b-6caf-44f5-9938-0d0c479fc19c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:20.151687 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-6484e78b-6caf-44f5-9938-0d0c479fc19c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1810 microversion: 2.20 time: 0.178933 Aug 26 16:00:20.152116 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 281/558] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:19 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:00:20.875844 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-a692948e-4ce7-4a8c-a53b-e94e8abd392c tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1267805082", "imageRef": "bcbdbb0c-7335-4427-a636-e2dc730274b6", "flavorRef": "452", "networks": [{"uuid": "93d3cdba-46e7-400a-a999-4977612a2c5c"}]}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:00:20.936002 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.network.neutron [None req-a692948e-4ce7-4a8c-a53b-e94e8abd392c tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] validate_networks() for [('93d3cdba-46e7-400a-a999-4977612a2c5c', None, None, None, None, None)] {{(pid=128304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 16:00:20.962125 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-7c83f369-4c13-46ea-9897-1a2b6eee37b5 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:20.962700 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-7c83f369-4c13-46ea-9897-1a2b6eee37b5 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:20.970891 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7c83f369-4c13-46ea-9897-1a2b6eee37b5 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:20.971471 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7c83f369-4c13-46ea-9897-1a2b6eee37b5 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:20.971908 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7c83f369-4c13-46ea-9897-1a2b6eee37b5 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:20.972651 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7c83f369-4c13-46ea-9897-1a2b6eee37b5 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:20.973097 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7c83f369-4c13-46ea-9897-1a2b6eee37b5 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:20.973519 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7c83f369-4c13-46ea-9897-1a2b6eee37b5 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:21.194538 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-7c83f369-4c13-46ea-9897-1a2b6eee37b5 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:21.203815 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-7c83f369-4c13-46ea-9897-1a2b6eee37b5 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1313 microversion: 2.1 time: 0.245707 Aug 26 16:00:21.204674 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 282/559] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:20 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:21.209755 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-6904c1fe-0d60-4533-9c21-be94693945c0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:21.210579 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-6904c1fe-0d60-4533-9c21-be94693945c0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:21.225276 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6904c1fe-0d60-4533-9c21-be94693945c0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:21.225682 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6904c1fe-0d60-4533-9c21-be94693945c0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:21.226123 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6904c1fe-0d60-4533-9c21-be94693945c0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:21.226859 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6904c1fe-0d60-4533-9c21-be94693945c0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:21.227350 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6904c1fe-0d60-4533-9c21-be94693945c0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:21.227779 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6904c1fe-0d60-4533-9c21-be94693945c0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:21.450726 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-6904c1fe-0d60-4533-9c21-be94693945c0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:21.467714 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-a692948e-4ce7-4a8c-a53b-e94e8abd392c tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Flavor limits 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 16:00:21.468128 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-a692948e-4ce7-4a8c-a53b-e94e8abd392c tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Image limits 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 16:00:21.468610 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-a692948e-4ce7-4a8c-a53b-e94e8abd392c tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Flavor pref 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 16:00:21.469026 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-a692948e-4ce7-4a8c-a53b-e94e8abd392c tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Image pref 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 16:00:21.469441 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-a692948e-4ce7-4a8c-a53b-e94e8abd392c tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 16:00:21.475403 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-6904c1fe-0d60-4533-9c21-be94693945c0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:21.476778 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-6904c1fe-0d60-4533-9c21-be94693945c0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:21.478003 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-6904c1fe-0d60-4533-9c21-be94693945c0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1810 microversion: 2.20 time: 0.272234 Aug 26 16:00:21.478579 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 283/560] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:21 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1810 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:21.480853 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a692948e-4ce7-4a8c-a53b-e94e8abd392c tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:21.481662 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a692948e-4ce7-4a8c-a53b-e94e8abd392c tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:21.482399 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a692948e-4ce7-4a8c-a53b-e94e8abd392c tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:21.483421 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a692948e-4ce7-4a8c-a53b-e94e8abd392c tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:21.484054 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a692948e-4ce7-4a8c-a53b-e94e8abd392c tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:21.484524 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a692948e-4ce7-4a8c-a53b-e94e8abd392c tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:21.503063 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-a692948e-4ce7-4a8c-a53b-e94e8abd392c tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Getting quotas for project f3a9b259e9d54603af734306adbfe16c. Resources: {'instances', 'ram', 'cores'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 16:00:21.507012 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-a692948e-4ce7-4a8c-a53b-e94e8abd392c tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Getting quotas for user a0ecfd3d64ba4fef820a31b1522125ff and project f3a9b259e9d54603af734306adbfe16c. Resources: {'instances', 'ram', 'cores'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 16:00:21.518765 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-a692948e-4ce7-4a8c-a53b-e94e8abd392c tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Going to run 1 instances... {{(pid=128304) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 16:00:21.521129 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-a692948e-4ce7-4a8c-a53b-e94e8abd392c tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bcbdbb0c-7335-4427-a636-e2dc730274b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 16:00:21.674353 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-a692948e-4ce7-4a8c-a53b-e94e8abd392c tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.803185 Aug 26 16:00:21.675050 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 278/561] 10.222.0.94 () {60 vars in 1147 bytes} [Fri Aug 26 16:00:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 16:00:21.686315 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-6f2f85f4-fc63-41f6-b05d-b90775521f63 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:21.686952 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-6f2f85f4-fc63-41f6-b05d-b90775521f63 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:21.742060 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-6f2f85f4-fc63-41f6-b05d-b90775521f63 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:21.750683 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-6f2f85f4-fc63-41f6-b05d-b90775521f63 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267" status: 200 len: 1219 microversion: 2.1 time: 0.068618 Aug 26 16:00:21.751306 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 284/562] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:21 2022] GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:22.226111 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f7dd18e2-0e1d-4e54-954a-581faeaaa1aa tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:22.226719 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-f7dd18e2-0e1d-4e54-954a-581faeaaa1aa tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:22.233905 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f7dd18e2-0e1d-4e54-954a-581faeaaa1aa tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:22.234390 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f7dd18e2-0e1d-4e54-954a-581faeaaa1aa tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:22.234827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f7dd18e2-0e1d-4e54-954a-581faeaaa1aa tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:22.235594 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f7dd18e2-0e1d-4e54-954a-581faeaaa1aa tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:22.236049 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f7dd18e2-0e1d-4e54-954a-581faeaaa1aa tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:22.236471 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f7dd18e2-0e1d-4e54-954a-581faeaaa1aa tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:22.368328 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-f7dd18e2-0e1d-4e54-954a-581faeaaa1aa tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:22.373596 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-f7dd18e2-0e1d-4e54-954a-581faeaaa1aa tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1313 microversion: 2.1 time: 0.151839 Aug 26 16:00:22.374168 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 279/563] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:22 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:22.501638 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-55643058-c941-403e-aa5c-11ad66652acf tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:22.502258 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-55643058-c941-403e-aa5c-11ad66652acf tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:22.509167 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-55643058-c941-403e-aa5c-11ad66652acf tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:22.509675 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-55643058-c941-403e-aa5c-11ad66652acf tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:22.510141 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-55643058-c941-403e-aa5c-11ad66652acf tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:22.510827 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-55643058-c941-403e-aa5c-11ad66652acf tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:22.511317 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-55643058-c941-403e-aa5c-11ad66652acf tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:22.511742 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-55643058-c941-403e-aa5c-11ad66652acf tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:22.644892 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-55643058-c941-403e-aa5c-11ad66652acf tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:22.654236 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-55643058-c941-403e-aa5c-11ad66652acf tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:22.659090 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-55643058-c941-403e-aa5c-11ad66652acf tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:22.659090 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-55643058-c941-403e-aa5c-11ad66652acf tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1810 microversion: 2.20 time: 0.159377 Aug 26 16:00:22.659090 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 285/564] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:22 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:22.771465 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-462f164a-441b-47c5-8425-7dbc520fde23 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:22.772073 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-462f164a-441b-47c5-8425-7dbc520fde23 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:22.778673 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-462f164a-441b-47c5-8425-7dbc520fde23 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:22.779187 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-462f164a-441b-47c5-8425-7dbc520fde23 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:22.779627 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-462f164a-441b-47c5-8425-7dbc520fde23 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:22.780318 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-462f164a-441b-47c5-8425-7dbc520fde23 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:22.780771 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-462f164a-441b-47c5-8425-7dbc520fde23 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:22.781218 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-462f164a-441b-47c5-8425-7dbc520fde23 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:22.844549 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-462f164a-441b-47c5-8425-7dbc520fde23 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:22.846697 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=100 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:00:22.852776 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-462f164a-441b-47c5-8425-7dbc520fde23 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267" status: 200 len: 1223 microversion: 2.1 time: 0.085205 Aug 26 16:00:22.853337 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 280/565] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:22 2022] GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:23.393638 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a763243c-b815-4f32-8c8a-70558645e94d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:23.394395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a763243c-b815-4f32-8c8a-70558645e94d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:23.400397 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a763243c-b815-4f32-8c8a-70558645e94d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:23.400818 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a763243c-b815-4f32-8c8a-70558645e94d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:23.401252 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a763243c-b815-4f32-8c8a-70558645e94d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:23.401942 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a763243c-b815-4f32-8c8a-70558645e94d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:23.402389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a763243c-b815-4f32-8c8a-70558645e94d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:23.403333 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a763243c-b815-4f32-8c8a-70558645e94d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:23.533843 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a763243c-b815-4f32-8c8a-70558645e94d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:23.541911 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a763243c-b815-4f32-8c8a-70558645e94d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1313 microversion: 2.1 time: 0.152172 Aug 26 16:00:23.542470 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 286/566] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:23 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:23.681243 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-431a410d-636a-4126-8fd2-a7bca7532246 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:23.681806 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-431a410d-636a-4126-8fd2-a7bca7532246 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:23.689661 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-431a410d-636a-4126-8fd2-a7bca7532246 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:23.690147 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-431a410d-636a-4126-8fd2-a7bca7532246 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:23.690587 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-431a410d-636a-4126-8fd2-a7bca7532246 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:23.691315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-431a410d-636a-4126-8fd2-a7bca7532246 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:23.691807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-431a410d-636a-4126-8fd2-a7bca7532246 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:23.692236 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-431a410d-636a-4126-8fd2-a7bca7532246 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:23.837349 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-431a410d-636a-4126-8fd2-a7bca7532246 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:23.846209 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-431a410d-636a-4126-8fd2-a7bca7532246 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:23.847722 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-431a410d-636a-4126-8fd2-a7bca7532246 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:23.848882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-431a410d-636a-4126-8fd2-a7bca7532246 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1810 microversion: 2.20 time: 0.172405 Aug 26 16:00:23.849441 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 281/567] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:23 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:23.873784 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-af20cb38-408c-43b2-afe9-6b77cfc891b0 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:23.874431 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-af20cb38-408c-43b2-afe9-6b77cfc891b0 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:23.880496 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-af20cb38-408c-43b2-afe9-6b77cfc891b0 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:23.881038 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-af20cb38-408c-43b2-afe9-6b77cfc891b0 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:23.881474 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-af20cb38-408c-43b2-afe9-6b77cfc891b0 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:23.882168 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-af20cb38-408c-43b2-afe9-6b77cfc891b0 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:23.882624 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-af20cb38-408c-43b2-afe9-6b77cfc891b0 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:23.883084 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-af20cb38-408c-43b2-afe9-6b77cfc891b0 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:23.945829 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-af20cb38-408c-43b2-afe9-6b77cfc891b0 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:23.954747 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-af20cb38-408c-43b2-afe9-6b77cfc891b0 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267" status: 200 len: 1223 microversion: 2.1 time: 0.085372 Aug 26 16:00:23.955561 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 287/568] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:23 2022] GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:00:24.563951 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-aed80eb3-e8c3-482f-a693-78613ecace77 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:24.564471 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-aed80eb3-e8c3-482f-a693-78613ecace77 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:24.570788 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-aed80eb3-e8c3-482f-a693-78613ecace77 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:24.571321 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-aed80eb3-e8c3-482f-a693-78613ecace77 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:24.571766 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-aed80eb3-e8c3-482f-a693-78613ecace77 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:24.572588 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-aed80eb3-e8c3-482f-a693-78613ecace77 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:24.573049 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-aed80eb3-e8c3-482f-a693-78613ecace77 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:24.573733 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-aed80eb3-e8c3-482f-a693-78613ecace77 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:24.780702 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-aed80eb3-e8c3-482f-a693-78613ecace77 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:24.787036 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-aed80eb3-e8c3-482f-a693-78613ecace77 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1313 microversion: 2.1 time: 0.227659 Aug 26 16:00:24.787611 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 282/569] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:24 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:24.871765 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-ce57bb92-81c3-4ff4-84e0-4ce41cbd1ae8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:24.872517 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-ce57bb92-81c3-4ff4-84e0-4ce41cbd1ae8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:24.879156 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ce57bb92-81c3-4ff4-84e0-4ce41cbd1ae8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:24.879658 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ce57bb92-81c3-4ff4-84e0-4ce41cbd1ae8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:24.880076 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ce57bb92-81c3-4ff4-84e0-4ce41cbd1ae8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:24.880765 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ce57bb92-81c3-4ff4-84e0-4ce41cbd1ae8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:24.881235 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ce57bb92-81c3-4ff4-84e0-4ce41cbd1ae8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:24.881664 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ce57bb92-81c3-4ff4-84e0-4ce41cbd1ae8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:24.975801 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-df4d73c4-d76f-4428-8dd3-d91c70e45082 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:24.976420 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-df4d73c4-d76f-4428-8dd3-d91c70e45082 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:24.982746 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-df4d73c4-d76f-4428-8dd3-d91c70e45082 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:24.983279 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-df4d73c4-d76f-4428-8dd3-d91c70e45082 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:24.983845 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-df4d73c4-d76f-4428-8dd3-d91c70e45082 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:24.984550 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-df4d73c4-d76f-4428-8dd3-d91c70e45082 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:24.985009 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-df4d73c4-d76f-4428-8dd3-d91c70e45082 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:24.985437 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-df4d73c4-d76f-4428-8dd3-d91c70e45082 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:25.023347 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-ce57bb92-81c3-4ff4-84e0-4ce41cbd1ae8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:25.033485 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-ce57bb92-81c3-4ff4-84e0-4ce41cbd1ae8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:25.035176 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-ce57bb92-81c3-4ff4-84e0-4ce41cbd1ae8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:25.036372 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-ce57bb92-81c3-4ff4-84e0-4ce41cbd1ae8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1810 microversion: 2.20 time: 0.168579 Aug 26 16:00:25.036958 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 288/570] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:24 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:25.052550 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-df4d73c4-d76f-4428-8dd3-d91c70e45082 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:25.060637 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-df4d73c4-d76f-4428-8dd3-d91c70e45082 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267" status: 200 len: 1215 microversion: 2.1 time: 0.088770 Aug 26 16:00:25.061223 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 283/571] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:24 2022] GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:00:25.812378 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-fe71ba3b-7728-4504-b0b2-4374da31bd7d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:25.812988 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-fe71ba3b-7728-4504-b0b2-4374da31bd7d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:25.819154 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fe71ba3b-7728-4504-b0b2-4374da31bd7d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:25.825491 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fe71ba3b-7728-4504-b0b2-4374da31bd7d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:25.825491 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fe71ba3b-7728-4504-b0b2-4374da31bd7d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:25.825491 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fe71ba3b-7728-4504-b0b2-4374da31bd7d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:25.825491 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fe71ba3b-7728-4504-b0b2-4374da31bd7d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:25.826141 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fe71ba3b-7728-4504-b0b2-4374da31bd7d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:25.962604 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-fe71ba3b-7728-4504-b0b2-4374da31bd7d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:25.974464 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-fe71ba3b-7728-4504-b0b2-4374da31bd7d tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1313 microversion: 2.1 time: 0.163636 Aug 26 16:00:25.974464 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 289/572] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:25 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:26.059800 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-82ff45ab-4db6-4c77-9c62-547743fc1002 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:26.060477 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-82ff45ab-4db6-4c77-9c62-547743fc1002 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:26.062773 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:00:26.067575 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-82ff45ab-4db6-4c77-9c62-547743fc1002 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:26.068065 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-82ff45ab-4db6-4c77-9c62-547743fc1002 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:26.068507 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-82ff45ab-4db6-4c77-9c62-547743fc1002 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:26.069244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-82ff45ab-4db6-4c77-9c62-547743fc1002 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:26.069697 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-82ff45ab-4db6-4c77-9c62-547743fc1002 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:26.070119 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-82ff45ab-4db6-4c77-9c62-547743fc1002 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:26.082402 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-1eed0e72-ae1d-40db-899c-5adf3b8f8764 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:26.083236 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-1eed0e72-ae1d-40db-899c-5adf3b8f8764 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:26.089765 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1eed0e72-ae1d-40db-899c-5adf3b8f8764 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:26.090819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1eed0e72-ae1d-40db-899c-5adf3b8f8764 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:26.091433 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1eed0e72-ae1d-40db-899c-5adf3b8f8764 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:26.092123 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1eed0e72-ae1d-40db-899c-5adf3b8f8764 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:26.092563 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1eed0e72-ae1d-40db-899c-5adf3b8f8764 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:26.092977 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1eed0e72-ae1d-40db-899c-5adf3b8f8764 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:26.175172 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-1eed0e72-ae1d-40db-899c-5adf3b8f8764 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:26.183667 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-1eed0e72-ae1d-40db-899c-5adf3b8f8764 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267" status: 200 len: 1271 microversion: 2.1 time: 0.105237 Aug 26 16:00:26.184649 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 290/573] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:26 2022] GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 => generated 1271 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:00:26.236755 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-82ff45ab-4db6-4c77-9c62-547743fc1002 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:26.245562 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-82ff45ab-4db6-4c77-9c62-547743fc1002 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:26.247168 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-82ff45ab-4db6-4c77-9c62-547743fc1002 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:26.248329 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-82ff45ab-4db6-4c77-9c62-547743fc1002 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1810 microversion: 2.20 time: 0.193112 Aug 26 16:00:26.248906 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 284/574] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:26 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1810 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:26.993935 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-87ae930a-729e-45af-9d5c-6f619242a8fd tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:26.994553 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-87ae930a-729e-45af-9d5c-6f619242a8fd tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:27.001929 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-87ae930a-729e-45af-9d5c-6f619242a8fd tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:27.002422 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-87ae930a-729e-45af-9d5c-6f619242a8fd tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:27.002855 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-87ae930a-729e-45af-9d5c-6f619242a8fd tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:27.003597 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-87ae930a-729e-45af-9d5c-6f619242a8fd tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:27.004049 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-87ae930a-729e-45af-9d5c-6f619242a8fd tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:27.004471 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-87ae930a-729e-45af-9d5c-6f619242a8fd tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:27.152097 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-87ae930a-729e-45af-9d5c-6f619242a8fd tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:27.156479 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=100 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:00:27.161057 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-87ae930a-729e-45af-9d5c-6f619242a8fd tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1463 microversion: 2.1 time: 0.171108 Aug 26 16:00:27.161629 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 291/575] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:26 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1463 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:27.205976 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-cefd8dfe-bbd6-4000-83a3-843534b95e0a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:27.207319 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-cefd8dfe-bbd6-4000-83a3-843534b95e0a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:27.208255 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-bd94f8fb-6cdf-49d6-a7a2-1d34c619fd53 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:27.208759 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-bd94f8fb-6cdf-49d6-a7a2-1d34c619fd53 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:27.213377 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cefd8dfe-bbd6-4000-83a3-843534b95e0a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:27.213864 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cefd8dfe-bbd6-4000-83a3-843534b95e0a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:27.214295 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cefd8dfe-bbd6-4000-83a3-843534b95e0a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:27.214655 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bd94f8fb-6cdf-49d6-a7a2-1d34c619fd53 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:27.215016 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cefd8dfe-bbd6-4000-83a3-843534b95e0a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:27.215203 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bd94f8fb-6cdf-49d6-a7a2-1d34c619fd53 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:27.216211 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bd94f8fb-6cdf-49d6-a7a2-1d34c619fd53 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:27.216411 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cefd8dfe-bbd6-4000-83a3-843534b95e0a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:27.216893 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cefd8dfe-bbd6-4000-83a3-843534b95e0a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:27.217031 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bd94f8fb-6cdf-49d6-a7a2-1d34c619fd53 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:27.217493 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bd94f8fb-6cdf-49d6-a7a2-1d34c619fd53 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:27.217922 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bd94f8fb-6cdf-49d6-a7a2-1d34c619fd53 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:27.245953 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-bd94f8fb-6cdf-49d6-a7a2-1d34c619fd53 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Going to try to terminate instance {{(pid=128305) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 16:00:27.285937 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-cefd8dfe-bbd6-4000-83a3-843534b95e0a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:27.294124 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-cefd8dfe-bbd6-4000-83a3-843534b95e0a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267" status: 200 len: 1271 microversion: 2.1 time: 0.091717 Aug 26 16:00:27.294699 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 285/576] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:27 2022] GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 => generated 1271 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:27.299279 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-4ec63205-c2c4-47ec-a55b-daaa6c79fe09 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:27.309030 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-4ec63205-c2c4-47ec-a55b-daaa6c79fe09 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:27.309030 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ec63205-c2c4-47ec-a55b-daaa6c79fe09 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:27.309030 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ec63205-c2c4-47ec-a55b-daaa6c79fe09 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:27.309030 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ec63205-c2c4-47ec-a55b-daaa6c79fe09 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:27.310867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ec63205-c2c4-47ec-a55b-daaa6c79fe09 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:27.310867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ec63205-c2c4-47ec-a55b-daaa6c79fe09 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:27.310867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ec63205-c2c4-47ec-a55b-daaa6c79fe09 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:27.445882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-4ec63205-c2c4-47ec-a55b-daaa6c79fe09 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:27.457413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-4ec63205-c2c4-47ec-a55b-daaa6c79fe09 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:27.458842 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-4ec63205-c2c4-47ec-a55b-daaa6c79fe09 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:27.460255 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-4ec63205-c2c4-47ec-a55b-daaa6c79fe09 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1810 microversion: 2.20 time: 0.164590 Aug 26 16:00:27.460987 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 286/577] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:27 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:27.605712 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-bd94f8fb-6cdf-49d6-a7a2-1d34c619fd53 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "DELETE /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 204 len: 0 microversion: 2.1 time: 0.401288 Aug 26 16:00:27.606897 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 292/578] 10.222.0.94 () {58 vars in 1239 bytes} [Fri Aug 26 16:00:27 2022] DELETE /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 16:00:27.615155 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-969d0000-4675-4247-a28a-22aca00d6589 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:27.619552 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-969d0000-4675-4247-a28a-22aca00d6589 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:27.621687 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-969d0000-4675-4247-a28a-22aca00d6589 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:27.622131 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-969d0000-4675-4247-a28a-22aca00d6589 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:27.622747 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-969d0000-4675-4247-a28a-22aca00d6589 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:27.623923 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-969d0000-4675-4247-a28a-22aca00d6589 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:27.624266 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-969d0000-4675-4247-a28a-22aca00d6589 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:27.624698 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-969d0000-4675-4247-a28a-22aca00d6589 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:27.761995 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-969d0000-4675-4247-a28a-22aca00d6589 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:27.770140 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-969d0000-4675-4247-a28a-22aca00d6589 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1469 microversion: 2.1 time: 0.158736 Aug 26 16:00:27.773025 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 287/579] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:27 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:28.316349 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-8f2a6fc9-1237-4fc0-acc3-b6b8f3ed01d1 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:28.317049 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-8f2a6fc9-1237-4fc0-acc3-b6b8f3ed01d1 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:28.323795 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8f2a6fc9-1237-4fc0-acc3-b6b8f3ed01d1 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:28.324276 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8f2a6fc9-1237-4fc0-acc3-b6b8f3ed01d1 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:28.325384 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8f2a6fc9-1237-4fc0-acc3-b6b8f3ed01d1 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:28.326166 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8f2a6fc9-1237-4fc0-acc3-b6b8f3ed01d1 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:28.326697 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8f2a6fc9-1237-4fc0-acc3-b6b8f3ed01d1 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:28.327123 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8f2a6fc9-1237-4fc0-acc3-b6b8f3ed01d1 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:28.404363 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-8f2a6fc9-1237-4fc0-acc3-b6b8f3ed01d1 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:28.411925 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-8f2a6fc9-1237-4fc0-acc3-b6b8f3ed01d1 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267" status: 200 len: 1279 microversion: 2.1 time: 0.100040 Aug 26 16:00:28.412484 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 293/580] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:28 2022] GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 => generated 1279 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:28.492432 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-e85ded5d-b2c0-41a6-a271-4a4764284811 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:28.493205 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-e85ded5d-b2c0-41a6-a271-4a4764284811 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:28.500804 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e85ded5d-b2c0-41a6-a271-4a4764284811 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:28.501283 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e85ded5d-b2c0-41a6-a271-4a4764284811 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:28.501713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e85ded5d-b2c0-41a6-a271-4a4764284811 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:28.502436 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e85ded5d-b2c0-41a6-a271-4a4764284811 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:28.502882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e85ded5d-b2c0-41a6-a271-4a4764284811 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:28.503352 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e85ded5d-b2c0-41a6-a271-4a4764284811 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:28.643967 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e85ded5d-b2c0-41a6-a271-4a4764284811 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:28.652462 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e85ded5d-b2c0-41a6-a271-4a4764284811 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:28.654132 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e85ded5d-b2c0-41a6-a271-4a4764284811 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:28.655311 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-e85ded5d-b2c0-41a6-a271-4a4764284811 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1810 microversion: 2.20 time: 0.166958 Aug 26 16:00:28.655865 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 288/581] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:28 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:28.793767 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-453b1cbf-b281-411a-8823-a5f702e76524 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:28.794586 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-453b1cbf-b281-411a-8823-a5f702e76524 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:28.800630 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-453b1cbf-b281-411a-8823-a5f702e76524 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:28.801112 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-453b1cbf-b281-411a-8823-a5f702e76524 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:28.801549 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-453b1cbf-b281-411a-8823-a5f702e76524 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:28.802239 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-453b1cbf-b281-411a-8823-a5f702e76524 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:28.802696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-453b1cbf-b281-411a-8823-a5f702e76524 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:28.803159 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-453b1cbf-b281-411a-8823-a5f702e76524 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:28.934306 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-453b1cbf-b281-411a-8823-a5f702e76524 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:28.942308 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-453b1cbf-b281-411a-8823-a5f702e76524 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1469 microversion: 2.1 time: 0.153056 Aug 26 16:00:28.942888 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 294/582] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:28 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1469 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:29.437781 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-9b5ece46-2b92-4dd4-be6f-8a1db6e685bd tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:29.438539 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-9b5ece46-2b92-4dd4-be6f-8a1db6e685bd tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:29.444579 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9b5ece46-2b92-4dd4-be6f-8a1db6e685bd tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:29.445069 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9b5ece46-2b92-4dd4-be6f-8a1db6e685bd tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:29.445512 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9b5ece46-2b92-4dd4-be6f-8a1db6e685bd tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:29.446248 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9b5ece46-2b92-4dd4-be6f-8a1db6e685bd tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:29.446712 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9b5ece46-2b92-4dd4-be6f-8a1db6e685bd tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:29.447168 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9b5ece46-2b92-4dd4-be6f-8a1db6e685bd tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:29.511400 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-9b5ece46-2b92-4dd4-be6f-8a1db6e685bd tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:29.519793 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-9b5ece46-2b92-4dd4-be6f-8a1db6e685bd tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267" status: 200 len: 1279 microversion: 2.1 time: 0.086182 Aug 26 16:00:29.524360 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 289/583] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:29 2022] GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 => generated 1279 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:29.679201 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-1242edcb-9c46-405c-b7b5-0726c197e2f6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:29.683333 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-1242edcb-9c46-405c-b7b5-0726c197e2f6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:29.687402 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1242edcb-9c46-405c-b7b5-0726c197e2f6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:29.688034 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1242edcb-9c46-405c-b7b5-0726c197e2f6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:29.688877 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1242edcb-9c46-405c-b7b5-0726c197e2f6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:29.689708 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1242edcb-9c46-405c-b7b5-0726c197e2f6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:29.690245 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1242edcb-9c46-405c-b7b5-0726c197e2f6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:29.690908 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1242edcb-9c46-405c-b7b5-0726c197e2f6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:29.970573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-73d85669-e28c-4186-9dec-e539b9c18984 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:29.971968 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-73d85669-e28c-4186-9dec-e539b9c18984 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:29.979301 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-73d85669-e28c-4186-9dec-e539b9c18984 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:29.980277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-73d85669-e28c-4186-9dec-e539b9c18984 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:29.981117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-73d85669-e28c-4186-9dec-e539b9c18984 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:29.981918 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-73d85669-e28c-4186-9dec-e539b9c18984 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:29.982366 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-73d85669-e28c-4186-9dec-e539b9c18984 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:29.982892 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-73d85669-e28c-4186-9dec-e539b9c18984 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:30.333647 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-1242edcb-9c46-405c-b7b5-0726c197e2f6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:30.342613 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-1242edcb-9c46-405c-b7b5-0726c197e2f6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:30.351726 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-1242edcb-9c46-405c-b7b5-0726c197e2f6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:30.351726 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-1242edcb-9c46-405c-b7b5-0726c197e2f6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1810 microversion: 2.20 time: 0.670368 Aug 26 16:00:30.351726 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 295/584] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:29 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1810 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:30.420180 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-73d85669-e28c-4186-9dec-e539b9c18984 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:30.428254 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-73d85669-e28c-4186-9dec-e539b9c18984 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1469 microversion: 2.1 time: 0.461793 Aug 26 16:00:30.431772 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 290/585] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:29 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1469 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:00:30.545768 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-dc33783a-6fb6-4782-94c1-375316e9437b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:30.546524 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-dc33783a-6fb6-4782-94c1-375316e9437b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:30.552627 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dc33783a-6fb6-4782-94c1-375316e9437b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:30.558043 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dc33783a-6fb6-4782-94c1-375316e9437b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:30.558043 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dc33783a-6fb6-4782-94c1-375316e9437b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:30.558043 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dc33783a-6fb6-4782-94c1-375316e9437b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:30.558043 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dc33783a-6fb6-4782-94c1-375316e9437b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:30.558408 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dc33783a-6fb6-4782-94c1-375316e9437b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:30.654684 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-dc33783a-6fb6-4782-94c1-375316e9437b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:30.662287 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-dc33783a-6fb6-4782-94c1-375316e9437b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267" status: 200 len: 1277 microversion: 2.1 time: 0.121058 Aug 26 16:00:30.662850 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 296/586] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:30 2022] GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 => generated 1277 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:30.881193 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-e744fb4c-209c-4348-8caf-6cee10839ae9 req-35a47da8-1cec-42f7-99a6-474a8f367d1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a303bb17-edbe-4802-9ddb-de27baaa162a", "name": "network-vif-deleted", "tag": "04480c9a-afaf-4f05-a159-cbd8adaaf019"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:00:30.906963 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-e744fb4c-209c-4348-8caf-6cee10839ae9 req-35a47da8-1cec-42f7-99a6-474a8f367d1d service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:30.907796 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-e744fb4c-209c-4348-8caf-6cee10839ae9 req-35a47da8-1cec-42f7-99a6-474a8f367d1d service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:30.908499 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-e744fb4c-209c-4348-8caf-6cee10839ae9 req-35a47da8-1cec-42f7-99a6-474a8f367d1d service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:30.928247 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-e744fb4c-209c-4348-8caf-6cee10839ae9 req-35a47da8-1cec-42f7-99a6-474a8f367d1d service nova] Creating event network-vif-deleted:04480c9a-afaf-4f05-a159-cbd8adaaf019 for instance a303bb17-edbe-4802-9ddb-de27baaa162a on hv-cinder-85144 Aug 26 16:00:30.935396 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-e744fb4c-209c-4348-8caf-6cee10839ae9 req-35a47da8-1cec-42f7-99a6-474a8f367d1d service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061389 Aug 26 16:00:30.936247 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 291/587] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:00:31.369272 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-31b6b654-410b-4c1d-815b-fdccbc887983 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:31.369888 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-31b6b654-410b-4c1d-815b-fdccbc887983 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:31.376497 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31b6b654-410b-4c1d-815b-fdccbc887983 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:31.376971 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31b6b654-410b-4c1d-815b-fdccbc887983 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:31.377398 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31b6b654-410b-4c1d-815b-fdccbc887983 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:31.378075 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31b6b654-410b-4c1d-815b-fdccbc887983 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:31.378518 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31b6b654-410b-4c1d-815b-fdccbc887983 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:31.378949 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31b6b654-410b-4c1d-815b-fdccbc887983 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:31.451691 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f359c836-50f0-427a-a3fd-ce7d14b61959 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:31.452398 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-f359c836-50f0-427a-a3fd-ce7d14b61959 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:31.458704 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f359c836-50f0-427a-a3fd-ce7d14b61959 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:31.459221 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f359c836-50f0-427a-a3fd-ce7d14b61959 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:31.459661 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f359c836-50f0-427a-a3fd-ce7d14b61959 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:31.460370 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f359c836-50f0-427a-a3fd-ce7d14b61959 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:31.460821 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f359c836-50f0-427a-a3fd-ce7d14b61959 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:31.461246 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f359c836-50f0-427a-a3fd-ce7d14b61959 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:31.493803 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell0:SELECT=2 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:00:31.514884 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell0:SELECT=6 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:00:31.540894 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-f359c836-50f0-427a-a3fd-ce7d14b61959 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:31.544272 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-31b6b654-410b-4c1d-815b-fdccbc887983 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:31.549327 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-f359c836-50f0-427a-a3fd-ce7d14b61959 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1427 microversion: 2.1 time: 0.103256 Aug 26 16:00:31.549912 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 292/588] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:31 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1427 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:00:31.553210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-31b6b654-410b-4c1d-815b-fdccbc887983 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:31.554768 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-31b6b654-410b-4c1d-815b-fdccbc887983 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:31.555960 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-31b6b654-410b-4c1d-815b-fdccbc887983 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1810 microversion: 2.20 time: 0.190610 Aug 26 16:00:31.556512 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 297/589] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:31 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1810 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:31.685249 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ad8387b0-ccdf-4316-97f1-5e04be50013b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:31.685851 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ad8387b0-ccdf-4316-97f1-5e04be50013b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:31.692214 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ad8387b0-ccdf-4316-97f1-5e04be50013b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:31.692687 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ad8387b0-ccdf-4316-97f1-5e04be50013b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:31.693117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ad8387b0-ccdf-4316-97f1-5e04be50013b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:31.693793 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ad8387b0-ccdf-4316-97f1-5e04be50013b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:31.694240 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ad8387b0-ccdf-4316-97f1-5e04be50013b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:31.694656 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ad8387b0-ccdf-4316-97f1-5e04be50013b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:31.826378 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-ad8387b0-ccdf-4316-97f1-5e04be50013b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:31.834099 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ad8387b0-ccdf-4316-97f1-5e04be50013b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267" status: 200 len: 1319 microversion: 2.1 time: 0.153245 Aug 26 16:00:31.834660 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 293/590] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:31 2022] GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:32.570742 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-f4b89272-f657-4178-8f8f-e9adf6d6c33a tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:32.571380 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-f4b89272-f657-4178-8f8f-e9adf6d6c33a tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:32.573563 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell0:SELECT=2 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:00:32.579069 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f4b89272-f657-4178-8f8f-e9adf6d6c33a tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:32.579551 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f4b89272-f657-4178-8f8f-e9adf6d6c33a tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:32.579889 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-3ab6ad63-85e3-4736-8e94-c6e01da69680 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:32.580356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f4b89272-f657-4178-8f8f-e9adf6d6c33a tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:32.580669 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-3ab6ad63-85e3-4736-8e94-c6e01da69680 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:32.580786 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f4b89272-f657-4178-8f8f-e9adf6d6c33a tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:32.581078 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f4b89272-f657-4178-8f8f-e9adf6d6c33a tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:32.581491 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f4b89272-f657-4178-8f8f-e9adf6d6c33a tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:32.587549 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3ab6ad63-85e3-4736-8e94-c6e01da69680 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:32.588650 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3ab6ad63-85e3-4736-8e94-c6e01da69680 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:32.588650 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3ab6ad63-85e3-4736-8e94-c6e01da69680 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:32.589347 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3ab6ad63-85e3-4736-8e94-c6e01da69680 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:32.590522 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3ab6ad63-85e3-4736-8e94-c6e01da69680 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:32.590522 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3ab6ad63-85e3-4736-8e94-c6e01da69680 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:32.670118 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-f4b89272-f657-4178-8f8f-e9adf6d6c33a tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:32.677989 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-f4b89272-f657-4178-8f8f-e9adf6d6c33a tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1427 microversion: 2.1 time: 0.110994 Aug 26 16:00:32.678570 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 298/591] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:32 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1427 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:32.738675 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-3ab6ad63-85e3-4736-8e94-c6e01da69680 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:32.748359 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-3ab6ad63-85e3-4736-8e94-c6e01da69680 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:32.749803 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-3ab6ad63-85e3-4736-8e94-c6e01da69680 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:32.750992 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-3ab6ad63-85e3-4736-8e94-c6e01da69680 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1810 microversion: 2.20 time: 0.175281 Aug 26 16:00:32.751558 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 294/592] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:32 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:00:32.855388 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-9b819a4c-a67c-416c-a8f4-d1e4ef9ca87a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:32.856645 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-9b819a4c-a67c-416c-a8f4-d1e4ef9ca87a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:32.862510 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9b819a4c-a67c-416c-a8f4-d1e4ef9ca87a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:32.863021 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9b819a4c-a67c-416c-a8f4-d1e4ef9ca87a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:32.863449 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9b819a4c-a67c-416c-a8f4-d1e4ef9ca87a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:32.864239 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9b819a4c-a67c-416c-a8f4-d1e4ef9ca87a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:32.864689 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9b819a4c-a67c-416c-a8f4-d1e4ef9ca87a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:32.865104 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9b819a4c-a67c-416c-a8f4-d1e4ef9ca87a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:32.998239 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-9b819a4c-a67c-416c-a8f4-d1e4ef9ca87a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:33.005800 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-9b819a4c-a67c-416c-a8f4-d1e4ef9ca87a tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267" status: 200 len: 1319 microversion: 2.1 time: 0.154233 Aug 26 16:00:33.006359 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 299/593] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:32 2022] GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:33.699961 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-e49486a5-bea9-434e-89af-6ce89dab98c4 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:33.700572 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-e49486a5-bea9-434e-89af-6ce89dab98c4 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:33.707000 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e49486a5-bea9-434e-89af-6ce89dab98c4 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:33.707489 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e49486a5-bea9-434e-89af-6ce89dab98c4 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:33.707928 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e49486a5-bea9-434e-89af-6ce89dab98c4 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:33.708620 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e49486a5-bea9-434e-89af-6ce89dab98c4 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:33.709109 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e49486a5-bea9-434e-89af-6ce89dab98c4 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:33.709539 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e49486a5-bea9-434e-89af-6ce89dab98c4 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:33.770364 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e49486a5-bea9-434e-89af-6ce89dab98c4 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:33.773494 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a262a89a-7063-4a63-a4c4-ddf8dd2f7cda tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:33.774107 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a262a89a-7063-4a63-a4c4-ddf8dd2f7cda tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:33.779224 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-e49486a5-bea9-434e-89af-6ce89dab98c4 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1427 microversion: 2.1 time: 0.082869 Aug 26 16:00:33.780015 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 295/594] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:33 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:33.781022 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a262a89a-7063-4a63-a4c4-ddf8dd2f7cda tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:33.781503 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a262a89a-7063-4a63-a4c4-ddf8dd2f7cda tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:33.781939 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a262a89a-7063-4a63-a4c4-ddf8dd2f7cda tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:33.782632 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a262a89a-7063-4a63-a4c4-ddf8dd2f7cda tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:33.783120 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a262a89a-7063-4a63-a4c4-ddf8dd2f7cda tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:33.783544 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a262a89a-7063-4a63-a4c4-ddf8dd2f7cda tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:33.919051 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a262a89a-7063-4a63-a4c4-ddf8dd2f7cda tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:33.927552 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a262a89a-7063-4a63-a4c4-ddf8dd2f7cda tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:33.928958 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a262a89a-7063-4a63-a4c4-ddf8dd2f7cda tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:33.930135 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a262a89a-7063-4a63-a4c4-ddf8dd2f7cda tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1810 microversion: 2.20 time: 0.160468 Aug 26 16:00:33.930687 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 300/595] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:33 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:00:34.025691 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-2fa622a8-6d60-4f54-aab9-7270173d8471 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:34.026553 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-2fa622a8-6d60-4f54-aab9-7270173d8471 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:34.039118 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2fa622a8-6d60-4f54-aab9-7270173d8471 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:34.039118 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2fa622a8-6d60-4f54-aab9-7270173d8471 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:34.039118 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2fa622a8-6d60-4f54-aab9-7270173d8471 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:34.039118 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2fa622a8-6d60-4f54-aab9-7270173d8471 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:34.039504 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2fa622a8-6d60-4f54-aab9-7270173d8471 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:34.039504 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2fa622a8-6d60-4f54-aab9-7270173d8471 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:34.286693 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-2fa622a8-6d60-4f54-aab9-7270173d8471 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:34.295374 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-2fa622a8-6d60-4f54-aab9-7270173d8471 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267" status: 200 len: 1319 microversion: 2.1 time: 0.273548 Aug 26 16:00:34.300436 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 296/596] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:34 2022] GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:34.800531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-9bb07770-d1f4-4158-b838-5147342a7d38 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:34.801092 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-9bb07770-d1f4-4158-b838-5147342a7d38 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:34.803395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:00:34.808057 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9bb07770-d1f4-4158-b838-5147342a7d38 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:34.808538 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9bb07770-d1f4-4158-b838-5147342a7d38 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:34.809687 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9bb07770-d1f4-4158-b838-5147342a7d38 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:34.810452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9bb07770-d1f4-4158-b838-5147342a7d38 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:34.810957 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9bb07770-d1f4-4158-b838-5147342a7d38 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:34.815841 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9bb07770-d1f4-4158-b838-5147342a7d38 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:34.842784 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9bb07770-d1f4-4158-b838-5147342a7d38 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:34.843296 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9bb07770-d1f4-4158-b838-5147342a7d38 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:34.843733 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9bb07770-d1f4-4158-b838-5147342a7d38 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:34.844175 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-9bb07770-d1f4-4158-b838-5147342a7d38 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lazy-loading 'fault' on Instance uuid a303bb17-edbe-4802-9ddb-de27baaa162a {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:00:34.892236 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-9bb07770-d1f4-4158-b838-5147342a7d38 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796e6d2c1d3a4ef59c464fb2e61affe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa98d1bd1c354b38b99eb85b741e44ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:34.895466 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-9bb07770-d1f4-4158-b838-5147342a7d38 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 200 len: 1303 microversion: 2.1 time: 0.098811 Aug 26 16:00:34.896046 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 301/597] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:34 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:34.926611 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-f21c9f2d-878a-4e93-ba85-cf190c72190e req-159476e5-b42d-4d9c-96e7-c684236e5c31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e7986b7-b3a1-4529-844e-52a8f7e4e267", "tag": "e5492052-f3ca-4f03-a11d-4f492a9b75db"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:00:34.937865 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-f21c9f2d-878a-4e93-ba85-cf190c72190e req-159476e5-b42d-4d9c-96e7-c684236e5c31 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:34.938349 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-f21c9f2d-878a-4e93-ba85-cf190c72190e req-159476e5-b42d-4d9c-96e7-c684236e5c31 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:34.938838 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-f21c9f2d-878a-4e93-ba85-cf190c72190e req-159476e5-b42d-4d9c-96e7-c684236e5c31 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:34.952927 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-0dde5d27-0edf-444f-9925-9c7954f6a1c4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:34.953533 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-0dde5d27-0edf-444f-9925-9c7954f6a1c4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:34.953771 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-f21c9f2d-878a-4e93-ba85-cf190c72190e req-159476e5-b42d-4d9c-96e7-c684236e5c31 service nova] Creating event network-changed:e5492052-f3ca-4f03-a11d-4f492a9b75db for instance 3e7986b7-b3a1-4529-844e-52a8f7e4e267 on hv-cinder-85144 Aug 26 16:00:34.961585 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0dde5d27-0edf-444f-9925-9c7954f6a1c4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:34.962238 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0dde5d27-0edf-444f-9925-9c7954f6a1c4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:34.962481 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-f21c9f2d-878a-4e93-ba85-cf190c72190e req-159476e5-b42d-4d9c-96e7-c684236e5c31 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039443 Aug 26 16:00:34.962872 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0dde5d27-0edf-444f-9925-9c7954f6a1c4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:34.963891 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0dde5d27-0edf-444f-9925-9c7954f6a1c4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:34.964489 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0dde5d27-0edf-444f-9925-9c7954f6a1c4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:34.964942 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0dde5d27-0edf-444f-9925-9c7954f6a1c4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:34.965864 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 297/598] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:00:35.102428 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-0dde5d27-0edf-444f-9925-9c7954f6a1c4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:35.112474 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-0dde5d27-0edf-444f-9925-9c7954f6a1c4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:35.117596 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-0dde5d27-0edf-444f-9925-9c7954f6a1c4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:35.117596 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-0dde5d27-0edf-444f-9925-9c7954f6a1c4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1810 microversion: 2.20 time: 0.166209 Aug 26 16:00:35.117596 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 302/599] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:34 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:00:35.317032 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-4de1a7ae-4655-42e5-bc10-072c8c200db5 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:35.317778 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-4de1a7ae-4655-42e5-bc10-072c8c200db5 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:35.324450 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4de1a7ae-4655-42e5-bc10-072c8c200db5 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:35.324936 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4de1a7ae-4655-42e5-bc10-072c8c200db5 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:35.325622 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4de1a7ae-4655-42e5-bc10-072c8c200db5 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:35.326296 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4de1a7ae-4655-42e5-bc10-072c8c200db5 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:35.326764 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4de1a7ae-4655-42e5-bc10-072c8c200db5 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:35.327205 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4de1a7ae-4655-42e5-bc10-072c8c200db5 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:35.524985 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-4de1a7ae-4655-42e5-bc10-072c8c200db5 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:35.527294 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=100 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:00:35.534172 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-4de1a7ae-4655-42e5-bc10-072c8c200db5 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267" status: 200 len: 1319 microversion: 2.1 time: 0.221331 Aug 26 16:00:35.534740 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 298/600] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:35 2022] GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:35.925637 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-363c2844-b3e0-4089-8c9f-ffa5ef587399 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:35.928655 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-363c2844-b3e0-4089-8c9f-ffa5ef587399 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] [instance: a303bb17-edbe-4802-9ddb-de27baaa162a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:35.933509 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-363c2844-b3e0-4089-8c9f-ffa5ef587399 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:35.934546 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-363c2844-b3e0-4089-8c9f-ffa5ef587399 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:35.935006 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-363c2844-b3e0-4089-8c9f-ffa5ef587399 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:35.935709 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-363c2844-b3e0-4089-8c9f-ffa5ef587399 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:35.936344 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-363c2844-b3e0-4089-8c9f-ffa5ef587399 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:35.936768 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-363c2844-b3e0-4089-8c9f-ffa5ef587399 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:35.955489 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.wsgi [None req-363c2844-b3e0-4089-8c9f-ffa5ef587399 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] HTTP exception thrown: Instance a303bb17-edbe-4802-9ddb-de27baaa162a could not be found. Aug 26 16:00:35.957531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-363c2844-b3e0-4089-8c9f-ffa5ef587399 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Request method failure captured: Aug 26 16:00:35.957531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: request: GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a HTTP/1.1 Aug 26 16:00:35.957531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept: application/json Aug 26 16:00:35.957531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept-Encoding: identity Aug 26 16:00:35.957531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Connection: close Aug 26 16:00:35.957531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Length: 0 Aug 26 16:00:35.957531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Type: application/json Aug 26 16:00:35.957531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Host: 10.222.0.94 Aug 26 16:00:35.957531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Openstack-System-Scope: None Aug 26 16:00:35.957531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: User-Agent: python-urllib3/1.26.11 Aug 26 16:00:35.957531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Auth-Token: gAAAAABjCO3x8jxJ7mEnX31btOJpuQhiSbKPOaFywW3m_OByCbx3VN4kc3at7QDM2BlDHWHfR8OASgWFUaehV4Tj4UsKj8A3YxGDJZgWfb32SSDcdBAjZbZA156Py0dTsL00mD5_6LSNMRNooT_LFB_d9DrUdWJvWGJsEhEnS9iuoHsMVkqV_IE Aug 26 16:00:35.957531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Id: None Aug 26 16:00:35.957531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Name: None Aug 26 16:00:35.957531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Identity-Status: Confirmed Aug 26 16:00:35.957531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Is-Admin-Project: True Aug 26 16:00:35.957531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Id: default Aug 26 16:00:35.957531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Name: Default Aug 26 16:00:35.957531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Id: aa98d1bd1c354b38b99eb85b741e44ab Aug 26 16:00:35.957531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Name: tempest-VolumesNegativeTest-2082754754 Aug 26 16:00:35.957531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Role: member,reader Aug 26 16:00:35.957531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Roles: member,reader Aug 26 16:00:35.960719 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/aa98d1bd1c354b38b99eb85b741e44ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/aa98d1bd1c354b38b99eb85b741e44ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/aa98d1bd1c354b38b99eb85b741e44ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_aa98d1bd1c354b38b99eb85b741e44ab", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:00:35.960719 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant: tempest-VolumesNegativeTest-2082754754 Aug 26 16:00:35.960719 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Id: aa98d1bd1c354b38b99eb85b741e44ab Aug 26 16:00:35.960719 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Name: tempest-VolumesNegativeTest-2082754754 Aug 26 16:00:35.960719 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User: tempest-VolumesNegativeTest-2082754754-project Aug 26 16:00:35.960719 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Id: default Aug 26 16:00:35.960719 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Name: Default Aug 26 16:00:35.960719 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Id: 796e6d2c1d3a4ef59c464fb2e61affe5 Aug 26 16:00:35.960719 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Name: tempest-VolumesNegativeTest-2082754754-project Aug 26 16:00:35.960719 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: method: > Aug 26 16:00:35.960719 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: exception: Instance a303bb17-edbe-4802-9ddb-de27baaa162a could not be found. Aug 26 16:00:35.960719 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: action_args: {'id': 'a303bb17-edbe-4802-9ddb-de27baaa162a'} Aug 26 16:00:35.962385 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:00:35.962385 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:00:35.962385 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:00:35.962385 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:00:35.962385 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:00:35.962385 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:00:35.962385 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:00:35.962385 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:00:35.962385 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:00:35.962385 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:00:35.962385 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a303bb17-edbe-4802-9ddb-de27baaa162a could not be found. Aug 26 16:00:35.962385 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:00:35.962385 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:00:35.962385 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:00:35.962385 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:00:35.962385 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:00:35.962385 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:00:35.962385 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:00:35.962385 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:00:35.962385 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:00:35.966384 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:00:35.966384 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:00:35.966384 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:00:35.966384 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:00:35.966384 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:00:35.966384 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:00:35.966384 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:00:35.966384 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a303bb17-edbe-4802-9ddb-de27baaa162a could not be found. Aug 26 16:00:35.966384 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:00:35.966384 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:00:35.966384 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:00:35.966384 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:00:35.966384 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:00:35.966384 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:00:35.966384 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:00:35.966384 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:00:35.966384 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a303bb17-edbe-4802-9ddb-de27baaa162a could not be found. Aug 26 16:00:35.966384 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:00:35.968524 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-363c2844-b3e0-4089-8c9f-ffa5ef587399 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] Returning 404 to user: Instance a303bb17-edbe-4802-9ddb-de27baaa162a could not be found. {{(pid=128305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:00:35.968524 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-363c2844-b3e0-4089-8c9f-ffa5ef587399 tempest-VolumesNegativeTest-2082754754 tempest-VolumesNegativeTest-2082754754-project] 10.222.0.94 "GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a" status: 404 len: 111 microversion: 2.1 time: 0.037823 Aug 26 16:00:35.968524 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 303/601] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:35 2022] GET /compute/v2.1/servers/a303bb17-edbe-4802-9ddb-de27baaa162a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:00:36.139044 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-c9960574-f5e9-4d12-8dd8-995b4c2fd5d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:36.139530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-c9960574-f5e9-4d12-8dd8-995b4c2fd5d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:36.146268 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c9960574-f5e9-4d12-8dd8-995b4c2fd5d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:36.150252 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c9960574-f5e9-4d12-8dd8-995b4c2fd5d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:36.150252 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c9960574-f5e9-4d12-8dd8-995b4c2fd5d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:36.150252 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c9960574-f5e9-4d12-8dd8-995b4c2fd5d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:36.150252 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c9960574-f5e9-4d12-8dd8-995b4c2fd5d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:36.150681 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c9960574-f5e9-4d12-8dd8-995b4c2fd5d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:36.295696 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-c9960574-f5e9-4d12-8dd8-995b4c2fd5d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:36.306048 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-c9960574-f5e9-4d12-8dd8-995b4c2fd5d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:36.316090 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-c9960574-f5e9-4d12-8dd8-995b4c2fd5d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:36.316090 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-c9960574-f5e9-4d12-8dd8-995b4c2fd5d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1810 microversion: 2.20 time: 0.175295 Aug 26 16:00:36.321019 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 299/602] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:36 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1810 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:36.555416 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-59b93ac6-c23a-4fb4-b490-81c8c3885fd2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:36.556140 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-59b93ac6-c23a-4fb4-b490-81c8c3885fd2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:36.563237 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-59b93ac6-c23a-4fb4-b490-81c8c3885fd2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:36.563816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-59b93ac6-c23a-4fb4-b490-81c8c3885fd2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:36.564323 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-59b93ac6-c23a-4fb4-b490-81c8c3885fd2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:36.565094 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-59b93ac6-c23a-4fb4-b490-81c8c3885fd2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:36.565617 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-59b93ac6-c23a-4fb4-b490-81c8c3885fd2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:36.566192 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-59b93ac6-c23a-4fb4-b490-81c8c3885fd2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:36.719539 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-59b93ac6-c23a-4fb4-b490-81c8c3885fd2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:36.727500 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-59b93ac6-c23a-4fb4-b490-81c8c3885fd2 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267" status: 200 len: 1319 microversion: 2.1 time: 0.175757 Aug 26 16:00:36.728166 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 304/603] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:36 2022] GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:37.332217 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-09b8ee6d-14f9-4ba4-8509-cf5b1e1bd9e1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:37.332908 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-09b8ee6d-14f9-4ba4-8509-cf5b1e1bd9e1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:37.339709 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-09b8ee6d-14f9-4ba4-8509-cf5b1e1bd9e1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:37.340888 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-09b8ee6d-14f9-4ba4-8509-cf5b1e1bd9e1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:37.341345 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-09b8ee6d-14f9-4ba4-8509-cf5b1e1bd9e1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:37.342055 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-09b8ee6d-14f9-4ba4-8509-cf5b1e1bd9e1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:37.342513 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-09b8ee6d-14f9-4ba4-8509-cf5b1e1bd9e1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:37.342991 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-09b8ee6d-14f9-4ba4-8509-cf5b1e1bd9e1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:37.496642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-09b8ee6d-14f9-4ba4-8509-cf5b1e1bd9e1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:37.508016 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-09b8ee6d-14f9-4ba4-8509-cf5b1e1bd9e1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:37.509559 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-09b8ee6d-14f9-4ba4-8509-cf5b1e1bd9e1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:37.511163 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-09b8ee6d-14f9-4ba4-8509-cf5b1e1bd9e1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1810 microversion: 2.20 time: 0.182814 Aug 26 16:00:37.512390 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 300/604] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:37 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1810 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:37.750563 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-9991abc2-e86b-4d17-a8f9-290b0867afd6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:37.751202 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-9991abc2-e86b-4d17-a8f9-290b0867afd6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:37.757923 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9991abc2-e86b-4d17-a8f9-290b0867afd6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:37.758464 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9991abc2-e86b-4d17-a8f9-290b0867afd6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:37.758901 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9991abc2-e86b-4d17-a8f9-290b0867afd6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:37.759619 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9991abc2-e86b-4d17-a8f9-290b0867afd6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:37.760251 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9991abc2-e86b-4d17-a8f9-290b0867afd6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:37.760671 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9991abc2-e86b-4d17-a8f9-290b0867afd6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:37.907408 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-9991abc2-e86b-4d17-a8f9-290b0867afd6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:37.916567 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-9991abc2-e86b-4d17-a8f9-290b0867afd6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267" status: 200 len: 1319 microversion: 2.1 time: 0.170739 Aug 26 16:00:37.917305 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 305/605] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:37 2022] GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:38.266296 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-4269c11e-7c85-4b57-843b-5d5442159467 req-dcef8992-d0be-4f61-b358-0da15cadc31f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac977a7-aa08-459a-a863-36ba667422d1", "name": "network-vif-plugged", "status": "completed", "tag": "8a53b00a-319e-4368-a0b0-216d2f508b1d"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:00:38.293460 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-4269c11e-7c85-4b57-843b-5d5442159467 req-dcef8992-d0be-4f61-b358-0da15cadc31f service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:38.294248 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-4269c11e-7c85-4b57-843b-5d5442159467 req-dcef8992-d0be-4f61-b358-0da15cadc31f service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:38.294945 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-4269c11e-7c85-4b57-843b-5d5442159467 req-dcef8992-d0be-4f61-b358-0da15cadc31f service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:38.317377 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-4269c11e-7c85-4b57-843b-5d5442159467 req-dcef8992-d0be-4f61-b358-0da15cadc31f service nova] Creating event network-vif-plugged:8a53b00a-319e-4368-a0b0-216d2f508b1d for instance 8ac977a7-aa08-459a-a863-36ba667422d1 on hv-cinder-85144 Aug 26 16:00:38.328811 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-4269c11e-7c85-4b57-843b-5d5442159467 req-dcef8992-d0be-4f61-b358-0da15cadc31f service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067389 Aug 26 16:00:38.329697 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 301/606] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:00:38.537922 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-1befe28f-40d1-4f41-b12a-39e5d66eadb5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:38.538535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-1befe28f-40d1-4f41-b12a-39e5d66eadb5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:38.545363 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1befe28f-40d1-4f41-b12a-39e5d66eadb5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:38.545852 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1befe28f-40d1-4f41-b12a-39e5d66eadb5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:38.546291 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1befe28f-40d1-4f41-b12a-39e5d66eadb5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:38.547021 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1befe28f-40d1-4f41-b12a-39e5d66eadb5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:38.547558 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1befe28f-40d1-4f41-b12a-39e5d66eadb5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:38.548020 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1befe28f-40d1-4f41-b12a-39e5d66eadb5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:38.690474 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-1befe28f-40d1-4f41-b12a-39e5d66eadb5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:38.702150 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-1befe28f-40d1-4f41-b12a-39e5d66eadb5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:38.706840 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-1befe28f-40d1-4f41-b12a-39e5d66eadb5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:38.706840 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-1befe28f-40d1-4f41-b12a-39e5d66eadb5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1810 microversion: 2.20 time: 0.171054 Aug 26 16:00:38.706840 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 306/607] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:38 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:38.939270 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-3fff5fb2-572b-424e-9f5b-933e51ae28a0 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:38.939974 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-3fff5fb2-572b-424e-9f5b-933e51ae28a0 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:38.948090 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3fff5fb2-572b-424e-9f5b-933e51ae28a0 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:38.948585 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3fff5fb2-572b-424e-9f5b-933e51ae28a0 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:38.949020 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3fff5fb2-572b-424e-9f5b-933e51ae28a0 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:38.950976 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3fff5fb2-572b-424e-9f5b-933e51ae28a0 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:38.950976 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3fff5fb2-572b-424e-9f5b-933e51ae28a0 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:38.950976 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3fff5fb2-572b-424e-9f5b-933e51ae28a0 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:39.116107 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-3fff5fb2-572b-424e-9f5b-933e51ae28a0 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:39.124658 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-3fff5fb2-572b-424e-9f5b-933e51ae28a0 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267" status: 200 len: 1319 microversion: 2.1 time: 0.190166 Aug 26 16:00:39.125510 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 302/608] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:38 2022] GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:39.727563 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-d4d0d8e3-6fdf-4874-8c81-36ba32e4ca33 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:39.728178 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-d4d0d8e3-6fdf-4874-8c81-36ba32e4ca33 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:39.738333 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d4d0d8e3-6fdf-4874-8c81-36ba32e4ca33 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:39.738846 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d4d0d8e3-6fdf-4874-8c81-36ba32e4ca33 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:39.739457 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d4d0d8e3-6fdf-4874-8c81-36ba32e4ca33 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:39.740225 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d4d0d8e3-6fdf-4874-8c81-36ba32e4ca33 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:39.740723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d4d0d8e3-6fdf-4874-8c81-36ba32e4ca33 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:39.741278 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d4d0d8e3-6fdf-4874-8c81-36ba32e4ca33 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:39.747067 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:00:39.894301 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d4d0d8e3-6fdf-4874-8c81-36ba32e4ca33 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:39.901242 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d4d0d8e3-6fdf-4874-8c81-36ba32e4ca33 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:39.902699 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d4d0d8e3-6fdf-4874-8c81-36ba32e4ca33 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:39.904037 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-d4d0d8e3-6fdf-4874-8c81-36ba32e4ca33 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1810 microversion: 2.20 time: 0.180472 Aug 26 16:00:39.904597 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 307/609] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:39 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:40.148110 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-16414e62-0533-4cc1-bb70-5fa17dd12442 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:40.148110 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-16414e62-0533-4cc1-bb70-5fa17dd12442 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:40.153062 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-16414e62-0533-4cc1-bb70-5fa17dd12442 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:40.153543 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-16414e62-0533-4cc1-bb70-5fa17dd12442 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:40.153973 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-16414e62-0533-4cc1-bb70-5fa17dd12442 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:40.154729 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-16414e62-0533-4cc1-bb70-5fa17dd12442 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:40.155200 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-16414e62-0533-4cc1-bb70-5fa17dd12442 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:40.155638 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-16414e62-0533-4cc1-bb70-5fa17dd12442 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:40.338595 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-16414e62-0533-4cc1-bb70-5fa17dd12442 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:40.347852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-16414e62-0533-4cc1-bb70-5fa17dd12442 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267" status: 200 len: 1319 microversion: 2.1 time: 0.206175 Aug 26 16:00:40.348440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 303/610] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:40 2022] GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:40.630889 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-546ef659-bf30-444e-965b-ba15df035043 req-8ce7dddc-f56d-40c7-8483-c2f3ff4da2c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e7986b7-b3a1-4529-844e-52a8f7e4e267", "name": "network-vif-plugged", "status": "completed", "tag": "e5492052-f3ca-4f03-a11d-4f492a9b75db"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:00:40.653502 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-546ef659-bf30-444e-965b-ba15df035043 req-8ce7dddc-f56d-40c7-8483-c2f3ff4da2c9 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:40.653502 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-546ef659-bf30-444e-965b-ba15df035043 req-8ce7dddc-f56d-40c7-8483-c2f3ff4da2c9 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:40.653502 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-546ef659-bf30-444e-965b-ba15df035043 req-8ce7dddc-f56d-40c7-8483-c2f3ff4da2c9 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:40.653502 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-546ef659-bf30-444e-965b-ba15df035043 req-8ce7dddc-f56d-40c7-8483-c2f3ff4da2c9 service nova] Creating event network-vif-plugged:e5492052-f3ca-4f03-a11d-4f492a9b75db for instance 3e7986b7-b3a1-4529-844e-52a8f7e4e267 on hv-cinder-85144 Aug 26 16:00:40.658248 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-546ef659-bf30-444e-965b-ba15df035043 req-8ce7dddc-f56d-40c7-8483-c2f3ff4da2c9 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031395 Aug 26 16:00:40.659027 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 308/611] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:00:40.928162 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-0de3c6f6-5ca1-4652-b241-a27161fc0604 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:40.928528 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-0de3c6f6-5ca1-4652-b241-a27161fc0604 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:40.936755 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0de3c6f6-5ca1-4652-b241-a27161fc0604 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:40.937641 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0de3c6f6-5ca1-4652-b241-a27161fc0604 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:40.937880 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0de3c6f6-5ca1-4652-b241-a27161fc0604 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:40.938708 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0de3c6f6-5ca1-4652-b241-a27161fc0604 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:40.939186 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0de3c6f6-5ca1-4652-b241-a27161fc0604 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:40.940358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0de3c6f6-5ca1-4652-b241-a27161fc0604 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:41.082967 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-0de3c6f6-5ca1-4652-b241-a27161fc0604 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:41.092525 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-0de3c6f6-5ca1-4652-b241-a27161fc0604 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:41.094026 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-0de3c6f6-5ca1-4652-b241-a27161fc0604 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:41.095235 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-0de3c6f6-5ca1-4652-b241-a27161fc0604 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1810 microversion: 2.20 time: 0.171649 Aug 26 16:00:41.095801 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 304/612] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:40 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:41.369095 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a533be3c-403f-4817-a163-799779347492 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:41.369983 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a533be3c-403f-4817-a163-799779347492 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:41.377733 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a533be3c-403f-4817-a163-799779347492 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:41.378212 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a533be3c-403f-4817-a163-799779347492 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:41.378653 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a533be3c-403f-4817-a163-799779347492 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:41.379429 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a533be3c-403f-4817-a163-799779347492 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:41.379884 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a533be3c-403f-4817-a163-799779347492 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:41.380309 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a533be3c-403f-4817-a163-799779347492 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:41.532476 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a533be3c-403f-4817-a163-799779347492 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:41.540551 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a533be3c-403f-4817-a163-799779347492 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267" status: 200 len: 1319 microversion: 2.1 time: 0.175604 Aug 26 16:00:41.541110 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 309/613] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:41 2022] GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:42.118951 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-1d15758c-8608-41a0-92af-f47b2597eaf5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:42.119604 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-1d15758c-8608-41a0-92af-f47b2597eaf5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:42.127340 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1d15758c-8608-41a0-92af-f47b2597eaf5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:42.127828 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1d15758c-8608-41a0-92af-f47b2597eaf5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:42.128266 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1d15758c-8608-41a0-92af-f47b2597eaf5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:42.128991 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1d15758c-8608-41a0-92af-f47b2597eaf5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:42.129662 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1d15758c-8608-41a0-92af-f47b2597eaf5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:42.130117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1d15758c-8608-41a0-92af-f47b2597eaf5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:42.276968 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-1d15758c-8608-41a0-92af-f47b2597eaf5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:42.291142 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-1d15758c-8608-41a0-92af-f47b2597eaf5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:42.292657 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-1d15758c-8608-41a0-92af-f47b2597eaf5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:42.294776 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-1d15758c-8608-41a0-92af-f47b2597eaf5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1810 microversion: 2.20 time: 0.179765 Aug 26 16:00:42.295604 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 305/614] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:42 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1810 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:00:42.568871 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-ce996a6b-f350-4478-9ce9-ac12e762a0ca tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:42.569577 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-ce996a6b-f350-4478-9ce9-ac12e762a0ca tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:42.580846 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ce996a6b-f350-4478-9ce9-ac12e762a0ca tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:42.581582 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ce996a6b-f350-4478-9ce9-ac12e762a0ca tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:42.582081 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ce996a6b-f350-4478-9ce9-ac12e762a0ca tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:42.583081 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ce996a6b-f350-4478-9ce9-ac12e762a0ca tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:42.583705 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ce996a6b-f350-4478-9ce9-ac12e762a0ca tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:42.584255 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ce996a6b-f350-4478-9ce9-ac12e762a0ca tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:42.741696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-ce996a6b-f350-4478-9ce9-ac12e762a0ca tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:42.749875 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-ce996a6b-f350-4478-9ce9-ac12e762a0ca tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267" status: 200 len: 1319 microversion: 2.1 time: 0.191977 Aug 26 16:00:42.750451 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 310/615] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:42 2022] GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:43.320100 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-b583e7df-6dfe-4a3e-a44b-f070d42ec897 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:43.320711 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-b583e7df-6dfe-4a3e-a44b-f070d42ec897 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:43.328694 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b583e7df-6dfe-4a3e-a44b-f070d42ec897 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:43.329106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b583e7df-6dfe-4a3e-a44b-f070d42ec897 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:43.329543 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b583e7df-6dfe-4a3e-a44b-f070d42ec897 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:43.330257 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b583e7df-6dfe-4a3e-a44b-f070d42ec897 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:43.330710 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b583e7df-6dfe-4a3e-a44b-f070d42ec897 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:43.331181 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b583e7df-6dfe-4a3e-a44b-f070d42ec897 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:43.481955 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-b583e7df-6dfe-4a3e-a44b-f070d42ec897 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:43.491210 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-b583e7df-6dfe-4a3e-a44b-f070d42ec897 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:43.492734 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-b583e7df-6dfe-4a3e-a44b-f070d42ec897 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:43.493967 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-b583e7df-6dfe-4a3e-a44b-f070d42ec897 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1797 microversion: 2.20 time: 0.177830 Aug 26 16:00:43.494535 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 306/616] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:00:43 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1797 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:00:43.771015 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-38c191fc-ebcd-4cc6-a7f3-e93fc4c864d7 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:43.771635 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-38c191fc-ebcd-4cc6-a7f3-e93fc4c864d7 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:43.792621 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-38c191fc-ebcd-4cc6-a7f3-e93fc4c864d7 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:43.794311 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-38c191fc-ebcd-4cc6-a7f3-e93fc4c864d7 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:43.794753 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-38c191fc-ebcd-4cc6-a7f3-e93fc4c864d7 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:43.795502 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-38c191fc-ebcd-4cc6-a7f3-e93fc4c864d7 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:43.795952 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-38c191fc-ebcd-4cc6-a7f3-e93fc4c864d7 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:43.796377 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-38c191fc-ebcd-4cc6-a7f3-e93fc4c864d7 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:43.961311 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-38c191fc-ebcd-4cc6-a7f3-e93fc4c864d7 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:43.974907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-38c191fc-ebcd-4cc6-a7f3-e93fc4c864d7 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267" status: 200 len: 1507 microversion: 2.1 time: 0.207577 Aug 26 16:00:43.975587 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 311/617] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:43 2022] GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 => generated 1507 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:44.004973 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f15fb167-2f1e-4996-82ea-c97d81b37930 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b40593b-279a-40cb-ab51-cd9e87e7ddd7", "device": "/dev/sdb"}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:00:44.008118 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-f15fb167-2f1e-4996-82ea-c97d81b37930 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:44.014458 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f15fb167-2f1e-4996-82ea-c97d81b37930 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:44.014971 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f15fb167-2f1e-4996-82ea-c97d81b37930 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:44.015410 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f15fb167-2f1e-4996-82ea-c97d81b37930 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:44.016110 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f15fb167-2f1e-4996-82ea-c97d81b37930 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:44.016561 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f15fb167-2f1e-4996-82ea-c97d81b37930 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:44.017012 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f15fb167-2f1e-4996-82ea-c97d81b37930 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:45.138825 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-f15fb167-2f1e-4996-82ea-c97d81b37930 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "POST /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.137572 Aug 26 16:00:45.145204 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 307/618] 10.222.0.94 () {60 vars in 1323 bytes} [Fri Aug 26 16:00:43 2022] POST /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267/os-volume_attachments => generated 194 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:00:52.664448 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-3641948f-287d-4049-b811-84bf89934471 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:52.665014 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-3641948f-287d-4049-b811-84bf89934471 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:52.672702 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3641948f-287d-4049-b811-84bf89934471 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:52.673499 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3641948f-287d-4049-b811-84bf89934471 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:52.674195 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3641948f-287d-4049-b811-84bf89934471 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:52.675655 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3641948f-287d-4049-b811-84bf89934471 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:52.676130 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3641948f-287d-4049-b811-84bf89934471 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:52.676560 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3641948f-287d-4049-b811-84bf89934471 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:52.703338 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-3641948f-287d-4049-b811-84bf89934471 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282/ips" status: 200 len: 147 microversion: 2.1 time: 0.042529 Aug 26 16:00:52.703929 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 312/619] 10.222.0.94 () {58 vars in 1248 bytes} [Fri Aug 26 16:00:52 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282/ips => generated 147 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:00:52.717139 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ccf549c0-57b8-4dc1-b1cd-2b0cea105db8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc38ae63-0f90-4fe5-a819-35260b1179fe"}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:00:52.719685 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ccf549c0-57b8-4dc1-b1cd-2b0cea105db8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:52.726130 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ccf549c0-57b8-4dc1-b1cd-2b0cea105db8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:52.726377 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ccf549c0-57b8-4dc1-b1cd-2b0cea105db8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:52.726814 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ccf549c0-57b8-4dc1-b1cd-2b0cea105db8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:52.727554 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ccf549c0-57b8-4dc1-b1cd-2b0cea105db8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:52.728085 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ccf549c0-57b8-4dc1-b1cd-2b0cea105db8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:52.728386 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ccf549c0-57b8-4dc1-b1cd-2b0cea105db8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:52.831055 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-ccf549c0-57b8-4dc1-b1cd-2b0cea105db8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] HTTP exception thrown: Invalid volume: volume fc38ae63-0f90-4fe5-a819-35260b1179fe is already attached to instances: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a Aug 26 16:00:52.833277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ccf549c0-57b8-4dc1-b1cd-2b0cea105db8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Request method failure captured: Aug 26 16:00:52.833277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: POST /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282/os-volume_attachments HTTP/1.1 Aug 26 16:00:52.833277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 16:00:52.833277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 16:00:52.833277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 16:00:52.833277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 74 Aug 26 16:00:52.833277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 16:00:52.833277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 16:00:52.833277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 16:00:52.833277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 16:00:52.833277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO074Vk8Knkkyah_6hQlXk9FvzAhBqPeYMng3gGU-fQ_qYYEN-UvSDuAz2OG4j3gRVAyM63Qk6cGXT3e_LJrqtVIQ2Wh_rCIb7SpxdZF5G6vc_eR0N-2MIzlwTSdPywpn1m7Hkaqaj-3SiKQy1JcwWLQlfAR9RAjH6drO8qCv3BIADQ Aug 26 16:00:52.833277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 16:00:52.833277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 16:00:52.833277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 16:00:52.833277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 16:00:52.833277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 16:00:52.833277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 16:00:52.833277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: d95f731096d74a089f4161f5db69280c Aug 26 16:00:52.833277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:00:52.833277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 16:00:52.833277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 16:00:52.834757 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/d95f731096d74a089f4161f5db69280c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/d95f731096d74a089f4161f5db69280c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/d95f731096d74a089f4161f5db69280c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_d95f731096d74a089f4161f5db69280c", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:00:52.834757 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:00:52.834757 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: d95f731096d74a089f4161f5db69280c Aug 26 16:00:52.834757 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:00:52.834757 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-AttachVolumeNegativeTest-243089979-project Aug 26 16:00:52.834757 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 16:00:52.834757 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 16:00:52.834757 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: b50041d36b0b430badd6442a2f09f063 Aug 26 16:00:52.834757 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-AttachVolumeNegativeTest-243089979-project Aug 26 16:00:52.834757 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Aug 26 16:00:52.834757 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {"volumeAttachment": {"volumeId": "fc38ae63-0f90-4fe5-a819-35260b1179fe"}} Aug 26 16:00:52.834757 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: > Aug 26 16:00:52.839084 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Invalid volume: volume fc38ae63-0f90-4fe5-a819-35260b1179fe is already attached to instances: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a Aug 26 16:00:52.839084 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'server_id': 'ae11b5f9-e68f-4300-82b2-65e2acc9b282', 'body': {'volumeAttachment': {'volumeId': 'fc38ae63-0f90-4fe5-a819-35260b1179fe'}}} Aug 26 16:00:52.839084 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:00:52.839084 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:00:52.839084 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 26 16:00:52.839084 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 26 16:00:52.839084 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 16:00:52.839084 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 16:00:52.839084 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 26 16:00:52.839084 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 26 16:00:52.839084 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 26 16:00:52.839084 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 26 16:00:52.839084 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 26 16:00:52.839084 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 26 16:00:52.839084 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fc38ae63-0f90-4fe5-a819-35260b1179fe is already attached to instances: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a Aug 26 16:00:52.839084 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:00:52.839084 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:00:52.839084 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:00:52.839084 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:00:52.840463 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:00:52.840463 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:00:52.840463 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:00:52.840463 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:00:52.840463 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:00:52.840463 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:00:52.840463 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 16:00:52.840463 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 16:00:52.840463 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 16:00:52.840463 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 16:00:52.840463 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 16:00:52.840463 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 16:00:52.840463 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 26 16:00:52.840463 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 26 16:00:52.840463 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fc38ae63-0f90-4fe5-a819-35260b1179fe is already attached to instances: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a Aug 26 16:00:52.840463 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:00:52.840463 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:00:52.840463 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:00:52.840463 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:00:52.840463 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:00:52.842039 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:00:52.842039 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:00:52.842039 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:00:52.842039 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fc38ae63-0f90-4fe5-a819-35260b1179fe is already attached to instances: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a Aug 26 16:00:52.842039 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:00:52.842039 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ccf549c0-57b8-4dc1-b1cd-2b0cea105db8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Returning 400 to user: Invalid volume: volume fc38ae63-0f90-4fe5-a819-35260b1179fe is already attached to instances: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:00:52.842039 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ccf549c0-57b8-4dc1-b1cd-2b0cea105db8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "POST /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.123459 Aug 26 16:00:52.842039 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 308/620] 10.222.0.94 () {60 vars in 1323 bytes} [Fri Aug 26 16:00:52 2022] POST /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282/os-volume_attachments => generated 174 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 26 16:00:52.844447 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-850bb076-4bc2-412b-8e2c-320b87ff7306 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:52.845147 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-850bb076-4bc2-412b-8e2c-320b87ff7306 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:52.851408 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-850bb076-4bc2-412b-8e2c-320b87ff7306 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:52.851898 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-850bb076-4bc2-412b-8e2c-320b87ff7306 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:52.852336 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-850bb076-4bc2-412b-8e2c-320b87ff7306 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:52.853050 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-850bb076-4bc2-412b-8e2c-320b87ff7306 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:52.853498 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-850bb076-4bc2-412b-8e2c-320b87ff7306 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:52.853921 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-850bb076-4bc2-412b-8e2c-320b87ff7306 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:52.881877 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-850bb076-4bc2-412b-8e2c-320b87ff7306 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Going to try to terminate instance {{(pid=128305) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 16:00:53.271536 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-850bb076-4bc2-412b-8e2c-320b87ff7306 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "DELETE /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 204 len: 0 microversion: 2.1 time: 0.430819 Aug 26 16:00:53.272413 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 313/621] 10.222.0.94 () {58 vars in 1239 bytes} [Fri Aug 26 16:00:52 2022] DELETE /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 16:00:53.284283 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-437554dd-adba-4148-a3b2-9c215c02ef3e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:53.284886 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-437554dd-adba-4148-a3b2-9c215c02ef3e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:53.292469 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-437554dd-adba-4148-a3b2-9c215c02ef3e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:53.293782 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-437554dd-adba-4148-a3b2-9c215c02ef3e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:53.294337 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-437554dd-adba-4148-a3b2-9c215c02ef3e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:53.295165 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-437554dd-adba-4148-a3b2-9c215c02ef3e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:53.295629 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-437554dd-adba-4148-a3b2-9c215c02ef3e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:53.296057 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-437554dd-adba-4148-a3b2-9c215c02ef3e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:53.514296 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-437554dd-adba-4148-a3b2-9c215c02ef3e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:53.530770 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-437554dd-adba-4148-a3b2-9c215c02ef3e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1677 microversion: 2.1 time: 0.250266 Aug 26 16:00:53.531863 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 309/622] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:53 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1677 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:54.554617 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-8fce4a66-f950-4506-af66-10d6573b625e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:54.555386 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-8fce4a66-f950-4506-af66-10d6573b625e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:54.563294 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8fce4a66-f950-4506-af66-10d6573b625e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:54.564054 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8fce4a66-f950-4506-af66-10d6573b625e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:54.564648 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8fce4a66-f950-4506-af66-10d6573b625e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:54.565525 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8fce4a66-f950-4506-af66-10d6573b625e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:54.566245 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8fce4a66-f950-4506-af66-10d6573b625e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:54.566954 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8fce4a66-f950-4506-af66-10d6573b625e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:54.738974 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-8fce4a66-f950-4506-af66-10d6573b625e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:54.749376 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-8fce4a66-f950-4506-af66-10d6573b625e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1677 microversion: 2.1 time: 0.198912 Aug 26 16:00:54.750496 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 314/623] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:54 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1677 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:00:55.775893 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-c1b2cc40-3fb1-4f19-81d1-6a4d576f0b9d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:55.778778 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-c1b2cc40-3fb1-4f19-81d1-6a4d576f0b9d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:55.814351 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c1b2cc40-3fb1-4f19-81d1-6a4d576f0b9d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:55.815234 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c1b2cc40-3fb1-4f19-81d1-6a4d576f0b9d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:55.816017 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c1b2cc40-3fb1-4f19-81d1-6a4d576f0b9d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:55.817233 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c1b2cc40-3fb1-4f19-81d1-6a4d576f0b9d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:55.817991 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c1b2cc40-3fb1-4f19-81d1-6a4d576f0b9d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:55.818706 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c1b2cc40-3fb1-4f19-81d1-6a4d576f0b9d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:56.006073 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-c1b2cc40-3fb1-4f19-81d1-6a4d576f0b9d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:56.018195 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-c1b2cc40-3fb1-4f19-81d1-6a4d576f0b9d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1677 microversion: 2.1 time: 0.247653 Aug 26 16:00:56.020824 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 310/624] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:55 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1677 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:56.513985 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-89a3d3e0-25bd-4486-8e72-5a6552a42494 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:56.516655 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-89a3d3e0-25bd-4486-8e72-5a6552a42494 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:56.524570 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-89a3d3e0-25bd-4486-8e72-5a6552a42494 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:56.525298 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-89a3d3e0-25bd-4486-8e72-5a6552a42494 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:56.525915 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-89a3d3e0-25bd-4486-8e72-5a6552a42494 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:56.526776 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-89a3d3e0-25bd-4486-8e72-5a6552a42494 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:56.527497 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-89a3d3e0-25bd-4486-8e72-5a6552a42494 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:56.528082 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-89a3d3e0-25bd-4486-8e72-5a6552a42494 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:56.670248 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-89a3d3e0-25bd-4486-8e72-5a6552a42494 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lazy-loading 'services' on Instance uuid f0e476ca-b4b7-4537-bfca-2c66b7246c3e {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:00:56.968821 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-89a3d3e0-25bd-4486-8e72-5a6552a42494 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "DELETE /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e/os-volume_attachments/7b0a7e6d-4c5e-44be-aaad-135a83e98872" status: 202 len: 0 microversion: 2.1 time: 0.463570 Aug 26 16:00:56.969425 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 315/625] 10.222.0.94 () {58 vars in 1416 bytes} [Fri Aug 26 16:00:56 2022] DELETE /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e/os-volume_attachments/7b0a7e6d-4c5e-44be-aaad-135a83e98872 => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 16:00:57.049941 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-110803b5-580c-46e7-8ab4-957d70e60a35 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:57.050802 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-110803b5-580c-46e7-8ab4-957d70e60a35 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:57.055989 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_api:SELECT=54 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:00:57.062304 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-110803b5-580c-46e7-8ab4-957d70e60a35 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:57.063832 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-110803b5-580c-46e7-8ab4-957d70e60a35 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:57.064220 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-110803b5-580c-46e7-8ab4-957d70e60a35 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:57.065810 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-110803b5-580c-46e7-8ab4-957d70e60a35 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:57.066319 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-110803b5-580c-46e7-8ab4-957d70e60a35 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:57.067128 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-110803b5-580c-46e7-8ab4-957d70e60a35 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:57.365757 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-110803b5-580c-46e7-8ab4-957d70e60a35 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:57.374462 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-110803b5-580c-46e7-8ab4-957d70e60a35 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1677 microversion: 2.1 time: 0.329591 Aug 26 16:00:57.375158 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 311/626] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:57 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1677 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:58.398346 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-dd543203-2b6f-474f-8fbc-56bdfdb0ced5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:58.400054 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-dd543203-2b6f-474f-8fbc-56bdfdb0ced5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:58.407775 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dd543203-2b6f-474f-8fbc-56bdfdb0ced5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:58.408555 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dd543203-2b6f-474f-8fbc-56bdfdb0ced5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:58.409347 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dd543203-2b6f-474f-8fbc-56bdfdb0ced5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:58.410240 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dd543203-2b6f-474f-8fbc-56bdfdb0ced5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:58.411045 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dd543203-2b6f-474f-8fbc-56bdfdb0ced5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:58.411797 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dd543203-2b6f-474f-8fbc-56bdfdb0ced5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:58.667923 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-dd543203-2b6f-474f-8fbc-56bdfdb0ced5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:00:58.679243 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-dd543203-2b6f-474f-8fbc-56bdfdb0ced5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1677 microversion: 2.1 time: 0.285520 Aug 26 16:00:58.680377 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 316/627] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:58 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1677 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:00:59.219234 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-bf37852b-9a7f-4164-8292-a22c4c497317 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c088d23-850b-48a9-94dc-d0ef2c0108f5"}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:00:59.224236 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-bf37852b-9a7f-4164-8292-a22c4c497317 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:59.248888 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bf37852b-9a7f-4164-8292-a22c4c497317 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:59.249753 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bf37852b-9a7f-4164-8292-a22c4c497317 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:59.252266 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bf37852b-9a7f-4164-8292-a22c4c497317 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:59.258987 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bf37852b-9a7f-4164-8292-a22c4c497317 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:59.258987 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bf37852b-9a7f-4164-8292-a22c4c497317 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:59.258987 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bf37852b-9a7f-4164-8292-a22c4c497317 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:59.742556 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-13db56d5-12d5-448e-8577-ce4daaedffde tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Action: 'create', calling method: .version_select at 0x7f15dcec65e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1225209664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHu48yI2zDJ5MZcXurFOhO7pvoglnJVT7R7LUD/mBlcRucBcNole4X40zh43y93J/MkPj1NIAJxp3AjMdQQg5Txe0NGocpJT0Spi5rdVKqtlSAy8r1OjJhMlKKmm1npm5Q=="}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:00:59.763268 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-13db56d5-12d5-448e-8577-ce4daaedffde tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Getting quotas for project ea82b722416a415393ff78428a277a01. Resources: {'key_pairs'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 16:00:59.767277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-13db56d5-12d5-448e-8577-ce4daaedffde tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Getting quotas for user 3b3abcfcc7c6408994e27b7c9937c2be and project ea82b722416a415393ff78428a277a01. Resources: {'key_pairs'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 16:00:59.895716 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-13db56d5-12d5-448e-8577-ce4daaedffde tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.383089 Aug 26 16:00:59.896405 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 317/628] 10.222.0.94 () {60 vars in 1159 bytes} [Fri Aug 26 16:00:59 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:00:59.902977 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-60cdb0aa-a1f2-44c5-abcd-5aca6ea6055c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:00:59.903510 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-60cdb0aa-a1f2-44c5-abcd-5aca6ea6055c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:00:59.910952 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-60cdb0aa-a1f2-44c5-abcd-5aca6ea6055c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:59.911581 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-60cdb0aa-a1f2-44c5-abcd-5aca6ea6055c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:59.911914 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-60cdb0aa-a1f2-44c5-abcd-5aca6ea6055c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:00:59.912612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-60cdb0aa-a1f2-44c5-abcd-5aca6ea6055c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:00:59.913058 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-60cdb0aa-a1f2-44c5-abcd-5aca6ea6055c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:00:59.913536 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-60cdb0aa-a1f2-44c5-abcd-5aca6ea6055c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:00.062885 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-60cdb0aa-a1f2-44c5-abcd-5aca6ea6055c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:00.073459 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-60cdb0aa-a1f2-44c5-abcd-5aca6ea6055c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1677 microversion: 2.1 time: 0.172559 Aug 26 16:01:00.073459 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 318/629] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:00:59 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:01.093884 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-d9e81a6d-08fa-4542-86c7-8dba249d29fa tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:01.094572 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-d9e81a6d-08fa-4542-86c7-8dba249d29fa tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:01.101004 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d9e81a6d-08fa-4542-86c7-8dba249d29fa tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:01.101492 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d9e81a6d-08fa-4542-86c7-8dba249d29fa tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:01.101925 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d9e81a6d-08fa-4542-86c7-8dba249d29fa tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:01.102624 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d9e81a6d-08fa-4542-86c7-8dba249d29fa tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:01.103121 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d9e81a6d-08fa-4542-86c7-8dba249d29fa tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:01.103548 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d9e81a6d-08fa-4542-86c7-8dba249d29fa tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:01.298044 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d9e81a6d-08fa-4542-86c7-8dba249d29fa tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:01.316396 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-d9e81a6d-08fa-4542-86c7-8dba249d29fa tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1677 microversion: 2.1 time: 0.227016 Aug 26 16:01:01.317328 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 319/630] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:01 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1677 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:01:02.338481 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-61ba5726-bc08-4d34-85b0-a1265448e5a7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:02.340318 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-61ba5726-bc08-4d34-85b0-a1265448e5a7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:02.356340 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-61ba5726-bc08-4d34-85b0-a1265448e5a7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:02.357220 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-61ba5726-bc08-4d34-85b0-a1265448e5a7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:02.357651 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-61ba5726-bc08-4d34-85b0-a1265448e5a7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:02.358504 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-61ba5726-bc08-4d34-85b0-a1265448e5a7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:02.358992 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-61ba5726-bc08-4d34-85b0-a1265448e5a7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:02.359383 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-61ba5726-bc08-4d34-85b0-a1265448e5a7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:02.594999 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-61ba5726-bc08-4d34-85b0-a1265448e5a7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:02.608464 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-61ba5726-bc08-4d34-85b0-a1265448e5a7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1677 microversion: 2.1 time: 0.272137 Aug 26 16:01:02.612115 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 320/631] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:02 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1677 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:03.634458 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-3cc1e317-1fd2-49f1-8d43-05a71aacf10a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:03.636864 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-3cc1e317-1fd2-49f1-8d43-05a71aacf10a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:03.645132 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3cc1e317-1fd2-49f1-8d43-05a71aacf10a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:03.645715 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3cc1e317-1fd2-49f1-8d43-05a71aacf10a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:03.646196 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3cc1e317-1fd2-49f1-8d43-05a71aacf10a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:03.646784 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3cc1e317-1fd2-49f1-8d43-05a71aacf10a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:03.647565 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3cc1e317-1fd2-49f1-8d43-05a71aacf10a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:03.648380 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3cc1e317-1fd2-49f1-8d43-05a71aacf10a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:03.801144 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-3cc1e317-1fd2-49f1-8d43-05a71aacf10a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:03.811291 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-3cc1e317-1fd2-49f1-8d43-05a71aacf10a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1677 microversion: 2.1 time: 0.181715 Aug 26 16:01:03.811866 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 321/632] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:03 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:04.833187 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-5a78e380-651a-4087-a4de-cd323ee22b51 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:04.833940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-5a78e380-651a-4087-a4de-cd323ee22b51 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:04.840523 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5a78e380-651a-4087-a4de-cd323ee22b51 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:04.846264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5a78e380-651a-4087-a4de-cd323ee22b51 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:04.846264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5a78e380-651a-4087-a4de-cd323ee22b51 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:04.846264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5a78e380-651a-4087-a4de-cd323ee22b51 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:04.846264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5a78e380-651a-4087-a4de-cd323ee22b51 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:04.846660 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5a78e380-651a-4087-a4de-cd323ee22b51 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:05.047780 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-5a78e380-651a-4087-a4de-cd323ee22b51 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:05.060494 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-5a78e380-651a-4087-a4de-cd323ee22b51 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1677 microversion: 2.1 time: 0.231219 Aug 26 16:01:05.061356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 322/633] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:04 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1677 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:01:05.848363 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-bf37852b-9a7f-4164-8292-a22c4c497317 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "POST /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.635496 Aug 26 16:01:05.849342 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 312/634] 10.222.0.94 () {60 vars in 1323 bytes} [Fri Aug 26 16:00:59 2022] POST /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653/os-volume_attachments => generated 194 bytes in 6638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:01:06.084259 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-d3def23e-a88a-44b0-bfae-16a186be1d45 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:06.084922 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-d3def23e-a88a-44b0-bfae-16a186be1d45 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:06.087753 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:01:06.097127 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d3def23e-a88a-44b0-bfae-16a186be1d45 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:06.101199 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d3def23e-a88a-44b0-bfae-16a186be1d45 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:06.101199 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d3def23e-a88a-44b0-bfae-16a186be1d45 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:06.101199 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d3def23e-a88a-44b0-bfae-16a186be1d45 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:06.101199 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d3def23e-a88a-44b0-bfae-16a186be1d45 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:06.101927 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d3def23e-a88a-44b0-bfae-16a186be1d45 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:06.157961 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:01:06.238017 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d3def23e-a88a-44b0-bfae-16a186be1d45 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:06.248137 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-d3def23e-a88a-44b0-bfae-16a186be1d45 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1609 microversion: 2.1 time: 0.167800 Aug 26 16:01:06.249389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 323/635] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:06 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1609 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:06.298656 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-3b1dcc7a-978b-4e55-aa08-557393511c3c req-e494a44d-0c02-4be8-91c0-fea7d685a3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae11b5f9-e68f-4300-82b2-65e2acc9b282", "name": "network-vif-deleted", "tag": "28a6367d-771f-4b85-b73b-d4f7949eaa49"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:01:06.310904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-3b1dcc7a-978b-4e55-aa08-557393511c3c req-e494a44d-0c02-4be8-91c0-fea7d685a3a7 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:06.311737 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-3b1dcc7a-978b-4e55-aa08-557393511c3c req-e494a44d-0c02-4be8-91c0-fea7d685a3a7 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:06.324569 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-3b1dcc7a-978b-4e55-aa08-557393511c3c req-e494a44d-0c02-4be8-91c0-fea7d685a3a7 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:06.325269 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:01:06.329011 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-3b1dcc7a-978b-4e55-aa08-557393511c3c req-e494a44d-0c02-4be8-91c0-fea7d685a3a7 service nova] Creating event network-vif-deleted:28a6367d-771f-4b85-b73b-d4f7949eaa49 for instance ae11b5f9-e68f-4300-82b2-65e2acc9b282 on hv-cinder-85144 Aug 26 16:01:06.335394 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-3b1dcc7a-978b-4e55-aa08-557393511c3c req-e494a44d-0c02-4be8-91c0-fea7d685a3a7 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041416 Aug 26 16:01:06.339003 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 313/636] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:01:06.892326 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-5f6e7051-d777-4fba-8250-0f72afdfab76 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:01:06.900456 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5f6e7051-d777-4fba-8250-0f72afdfab76 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:06.900917 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5f6e7051-d777-4fba-8250-0f72afdfab76 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:06.901993 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5f6e7051-d777-4fba-8250-0f72afdfab76 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:06.926459 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-5f6e7051-d777-4fba-8250-0f72afdfab76 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Going to try to stop instance {{(pid=128305) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 26 16:01:07.192033 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-5f6e7051-d777-4fba-8250-0f72afdfab76 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "POST /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e/action" status: 202 len: 0 microversion: 2.1 time: 0.303614 Aug 26 16:01:07.193677 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 324/637] 10.222.0.94 () {60 vars in 1278 bytes} [Fri Aug 26 16:01:06 2022] POST /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 16:01:07.205922 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-09c3bdf2-5404-4e63-937a-f581630281d5 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:07.207643 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-09c3bdf2-5404-4e63-937a-f581630281d5 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:07.218363 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-09c3bdf2-5404-4e63-937a-f581630281d5 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:07.220258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-09c3bdf2-5404-4e63-937a-f581630281d5 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:07.221355 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-09c3bdf2-5404-4e63-937a-f581630281d5 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:07.222471 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-09c3bdf2-5404-4e63-937a-f581630281d5 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:07.223689 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-09c3bdf2-5404-4e63-937a-f581630281d5 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:07.224380 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-09c3bdf2-5404-4e63-937a-f581630281d5 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:07.275371 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-afa59fd7-aa58-473f-96a0-875304e430ff tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:07.277367 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-afa59fd7-aa58-473f-96a0-875304e430ff tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:07.301172 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-afa59fd7-aa58-473f-96a0-875304e430ff tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:07.306166 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-afa59fd7-aa58-473f-96a0-875304e430ff tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:07.306166 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-afa59fd7-aa58-473f-96a0-875304e430ff tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:07.306166 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-afa59fd7-aa58-473f-96a0-875304e430ff tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:07.306166 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-afa59fd7-aa58-473f-96a0-875304e430ff tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:07.306754 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-afa59fd7-aa58-473f-96a0-875304e430ff tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:07.354573 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-afa59fd7-aa58-473f-96a0-875304e430ff tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:07.355449 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-afa59fd7-aa58-473f-96a0-875304e430ff tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:07.356059 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-afa59fd7-aa58-473f-96a0-875304e430ff tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:07.356605 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-afa59fd7-aa58-473f-96a0-875304e430ff tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lazy-loading 'fault' on Instance uuid ae11b5f9-e68f-4300-82b2-65e2acc9b282 {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:01:07.416890 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-afa59fd7-aa58-473f-96a0-875304e430ff tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:07.427382 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-afa59fd7-aa58-473f-96a0-875304e430ff tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1329 microversion: 2.1 time: 0.157798 Aug 26 16:01:07.428673 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 325/638] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:07 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1329 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:07.456227 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-09c3bdf2-5404-4e63-937a-f581630281d5 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:07.466861 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-09c3bdf2-5404-4e63-937a-f581630281d5 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1678 microversion: 2.1 time: 0.268108 Aug 26 16:01:07.467984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 314/639] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:07 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1678 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:08.450133 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-76531fff-9f90-4a31-8375-7faadf3ac494 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:08.450992 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-76531fff-9f90-4a31-8375-7faadf3ac494 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:08.458946 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-76531fff-9f90-4a31-8375-7faadf3ac494 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:08.459430 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-76531fff-9f90-4a31-8375-7faadf3ac494 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:08.459862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-76531fff-9f90-4a31-8375-7faadf3ac494 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:08.460582 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-76531fff-9f90-4a31-8375-7faadf3ac494 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:08.461032 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-76531fff-9f90-4a31-8375-7faadf3ac494 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:08.461601 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-76531fff-9f90-4a31-8375-7faadf3ac494 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:08.495740 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7dca3cea-d6c8-449c-a865-0e7a0cc7528b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:08.496516 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-7dca3cea-d6c8-449c-a865-0e7a0cc7528b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:08.498609 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-76531fff-9f90-4a31-8375-7faadf3ac494 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:08.499156 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-76531fff-9f90-4a31-8375-7faadf3ac494 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:08.499596 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-76531fff-9f90-4a31-8375-7faadf3ac494 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:08.500055 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-76531fff-9f90-4a31-8375-7faadf3ac494 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lazy-loading 'fault' on Instance uuid ae11b5f9-e68f-4300-82b2-65e2acc9b282 {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:01:08.506369 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7dca3cea-d6c8-449c-a865-0e7a0cc7528b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:08.507448 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7dca3cea-d6c8-449c-a865-0e7a0cc7528b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:08.508183 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7dca3cea-d6c8-449c-a865-0e7a0cc7528b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:08.508848 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7dca3cea-d6c8-449c-a865-0e7a0cc7528b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:08.509453 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7dca3cea-d6c8-449c-a865-0e7a0cc7528b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:08.509953 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7dca3cea-d6c8-449c-a865-0e7a0cc7528b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:08.546252 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-76531fff-9f90-4a31-8375-7faadf3ac494 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:08.554867 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-76531fff-9f90-4a31-8375-7faadf3ac494 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1329 microversion: 2.1 time: 0.108493 Aug 26 16:01:08.555490 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 326/640] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:08 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1329 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:08.659166 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7dca3cea-d6c8-449c-a865-0e7a0cc7528b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:08.667930 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-7dca3cea-d6c8-449c-a865-0e7a0cc7528b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1678 microversion: 2.1 time: 0.179769 Aug 26 16:01:08.668501 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 315/641] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:08 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:01:09.577239 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-861e2e4f-e7f9-4518-b5f4-a9f81547dfd2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:09.577783 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-861e2e4f-e7f9-4518-b5f4-a9f81547dfd2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:09.584414 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-861e2e4f-e7f9-4518-b5f4-a9f81547dfd2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:09.584944 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-861e2e4f-e7f9-4518-b5f4-a9f81547dfd2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:09.585378 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-861e2e4f-e7f9-4518-b5f4-a9f81547dfd2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:09.586090 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-861e2e4f-e7f9-4518-b5f4-a9f81547dfd2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:09.586544 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-861e2e4f-e7f9-4518-b5f4-a9f81547dfd2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:09.587001 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-861e2e4f-e7f9-4518-b5f4-a9f81547dfd2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:09.619573 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-861e2e4f-e7f9-4518-b5f4-a9f81547dfd2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:09.620051 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-861e2e4f-e7f9-4518-b5f4-a9f81547dfd2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:09.620488 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-861e2e4f-e7f9-4518-b5f4-a9f81547dfd2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:09.620937 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-861e2e4f-e7f9-4518-b5f4-a9f81547dfd2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lazy-loading 'fault' on Instance uuid ae11b5f9-e68f-4300-82b2-65e2acc9b282 {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:01:09.661789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-861e2e4f-e7f9-4518-b5f4-a9f81547dfd2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:09.669889 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-861e2e4f-e7f9-4518-b5f4-a9f81547dfd2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1329 microversion: 2.1 time: 0.097139 Aug 26 16:01:09.670728 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 327/642] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:09 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1329 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:09.690084 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-de4fd95e-2d48-4590-81cd-1d2f7e786534 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:09.690736 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-de4fd95e-2d48-4590-81cd-1d2f7e786534 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:09.699946 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-de4fd95e-2d48-4590-81cd-1d2f7e786534 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:09.700811 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-de4fd95e-2d48-4590-81cd-1d2f7e786534 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:09.701808 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-de4fd95e-2d48-4590-81cd-1d2f7e786534 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:09.702815 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-de4fd95e-2d48-4590-81cd-1d2f7e786534 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:09.703668 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-de4fd95e-2d48-4590-81cd-1d2f7e786534 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:09.704389 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-de4fd95e-2d48-4590-81cd-1d2f7e786534 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:09.844836 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-de4fd95e-2d48-4590-81cd-1d2f7e786534 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:09.852678 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-de4fd95e-2d48-4590-81cd-1d2f7e786534 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1678 microversion: 2.1 time: 0.167028 Aug 26 16:01:09.853257 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 316/643] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:09 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:10.691214 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-28b0b431-1782-4d73-b0a6-81b3350324b0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:10.691792 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-28b0b431-1782-4d73-b0a6-81b3350324b0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:10.693760 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell0:SELECT=4 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:01:10.699482 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-28b0b431-1782-4d73-b0a6-81b3350324b0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:10.699913 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-28b0b431-1782-4d73-b0a6-81b3350324b0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:10.700347 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-28b0b431-1782-4d73-b0a6-81b3350324b0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:10.701636 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-28b0b431-1782-4d73-b0a6-81b3350324b0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:10.702096 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-28b0b431-1782-4d73-b0a6-81b3350324b0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:10.702516 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-28b0b431-1782-4d73-b0a6-81b3350324b0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:10.735281 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-28b0b431-1782-4d73-b0a6-81b3350324b0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:10.735749 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-28b0b431-1782-4d73-b0a6-81b3350324b0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:10.736170 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-28b0b431-1782-4d73-b0a6-81b3350324b0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:10.736605 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-28b0b431-1782-4d73-b0a6-81b3350324b0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lazy-loading 'fault' on Instance uuid ae11b5f9-e68f-4300-82b2-65e2acc9b282 {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:01:10.779608 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-28b0b431-1782-4d73-b0a6-81b3350324b0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:10.787460 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-28b0b431-1782-4d73-b0a6-81b3350324b0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 200 len: 1329 microversion: 2.1 time: 0.100224 Aug 26 16:01:10.788098 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 328/644] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:10 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 1329 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:10.874956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-639ee27a-02d3-4132-98a4-8522007b395c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:10.875624 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-639ee27a-02d3-4132-98a4-8522007b395c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:10.882513 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-639ee27a-02d3-4132-98a4-8522007b395c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:10.883028 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-639ee27a-02d3-4132-98a4-8522007b395c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:10.883470 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-639ee27a-02d3-4132-98a4-8522007b395c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:10.884183 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-639ee27a-02d3-4132-98a4-8522007b395c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:10.884673 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-639ee27a-02d3-4132-98a4-8522007b395c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:10.888199 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-639ee27a-02d3-4132-98a4-8522007b395c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:11.032740 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-639ee27a-02d3-4132-98a4-8522007b395c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:11.042016 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-639ee27a-02d3-4132-98a4-8522007b395c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1678 microversion: 2.1 time: 0.171197 Aug 26 16:01:11.042604 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 317/645] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:10 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:11.810623 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-d6d2651e-8a69-40ab-84ad-779414a91f1f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:11.811922 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-d6d2651e-8a69-40ab-84ad-779414a91f1f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:11.818551 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d6d2651e-8a69-40ab-84ad-779414a91f1f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:11.819078 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d6d2651e-8a69-40ab-84ad-779414a91f1f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:11.819516 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d6d2651e-8a69-40ab-84ad-779414a91f1f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:11.820222 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d6d2651e-8a69-40ab-84ad-779414a91f1f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:11.820672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d6d2651e-8a69-40ab-84ad-779414a91f1f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:11.821101 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d6d2651e-8a69-40ab-84ad-779414a91f1f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:11.837995 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.wsgi [None req-d6d2651e-8a69-40ab-84ad-779414a91f1f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] HTTP exception thrown: Instance ae11b5f9-e68f-4300-82b2-65e2acc9b282 could not be found. Aug 26 16:01:11.839610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-d6d2651e-8a69-40ab-84ad-779414a91f1f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Request method failure captured: Aug 26 16:01:11.839610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: request: GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 HTTP/1.1 Aug 26 16:01:11.839610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept: application/json Aug 26 16:01:11.839610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept-Encoding: identity Aug 26 16:01:11.839610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Connection: close Aug 26 16:01:11.839610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Length: 0 Aug 26 16:01:11.839610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Type: application/json Aug 26 16:01:11.839610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Host: 10.222.0.94 Aug 26 16:01:11.839610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Openstack-System-Scope: None Aug 26 16:01:11.839610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: User-Agent: python-urllib3/1.26.11 Aug 26 16:01:11.839610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Auth-Token: gAAAAABjCO074Vk8Knkkyah_6hQlXk9FvzAhBqPeYMng3gGU-fQ_qYYEN-UvSDuAz2OG4j3gRVAyM63Qk6cGXT3e_LJrqtVIQ2Wh_rCIb7SpxdZF5G6vc_eR0N-2MIzlwTSdPywpn1m7Hkaqaj-3SiKQy1JcwWLQlfAR9RAjH6drO8qCv3BIADQ Aug 26 16:01:11.839610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Id: None Aug 26 16:01:11.839610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Name: None Aug 26 16:01:11.839610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Identity-Status: Confirmed Aug 26 16:01:11.839610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Is-Admin-Project: True Aug 26 16:01:11.839610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Id: default Aug 26 16:01:11.839610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Name: Default Aug 26 16:01:11.839610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Id: d95f731096d74a089f4161f5db69280c Aug 26 16:01:11.839610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Name: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:01:11.839610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Role: member,reader Aug 26 16:01:11.839610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Roles: member,reader Aug 26 16:01:11.841058 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/d95f731096d74a089f4161f5db69280c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/d95f731096d74a089f4161f5db69280c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/d95f731096d74a089f4161f5db69280c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_d95f731096d74a089f4161f5db69280c", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:01:11.841058 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:01:11.841058 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Id: d95f731096d74a089f4161f5db69280c Aug 26 16:01:11.841058 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:01:11.841058 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User: tempest-AttachVolumeNegativeTest-243089979-project Aug 26 16:01:11.841058 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Id: default Aug 26 16:01:11.841058 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Name: Default Aug 26 16:01:11.841058 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Id: b50041d36b0b430badd6442a2f09f063 Aug 26 16:01:11.841058 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Name: tempest-AttachVolumeNegativeTest-243089979-project Aug 26 16:01:11.841058 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: method: > Aug 26 16:01:11.841058 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: exception: Instance ae11b5f9-e68f-4300-82b2-65e2acc9b282 could not be found. Aug 26 16:01:11.841058 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: action_args: {'id': 'ae11b5f9-e68f-4300-82b2-65e2acc9b282'} Aug 26 16:01:11.842339 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:01:11.842339 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:11.842339 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:01:11.842339 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:01:11.842339 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:01:11.842339 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:01:11.842339 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:01:11.842339 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:01:11.842339 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:01:11.842339 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:01:11.842339 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae11b5f9-e68f-4300-82b2-65e2acc9b282 could not be found. Aug 26 16:01:11.842339 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:01:11.842339 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:01:11.842339 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:01:11.842339 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:11.842339 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:01:11.842339 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:01:11.842339 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:01:11.842339 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:01:11.842339 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:01:11.844156 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:01:11.844156 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:01:11.844156 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:01:11.844156 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:01:11.844156 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:01:11.844156 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:01:11.844156 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:01:11.844156 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae11b5f9-e68f-4300-82b2-65e2acc9b282 could not be found. Aug 26 16:01:11.844156 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:01:11.844156 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:01:11.844156 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:01:11.844156 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:11.844156 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:01:11.844156 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:01:11.844156 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:01:11.844156 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:01:11.844156 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae11b5f9-e68f-4300-82b2-65e2acc9b282 could not be found. Aug 26 16:01:11.844156 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:01:11.845653 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-d6d2651e-8a69-40ab-84ad-779414a91f1f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Returning 404 to user: Instance ae11b5f9-e68f-4300-82b2-65e2acc9b282 could not be found. {{(pid=128305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:01:11.845653 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-d6d2651e-8a69-40ab-84ad-779414a91f1f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 404 len: 111 microversion: 2.1 time: 0.035211 Aug 26 16:01:11.845653 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 329/646] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:11 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:01:11.850835 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-dfbdbd72-8ed2-4145-a2b8-49ea06fb75ff tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '.version_select at 0x7f15d94c83a0>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:11.952566 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-dfbdbd72-8ed2-4145-a2b8-49ea06fb75ff tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-21028649" status: 202 len: 0 microversion: 2.1 time: 0.105611 Aug 26 16:01:11.953224 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 318/647] 10.222.0.94 () {58 vars in 1215 bytes} [Fri Aug 26 16:01:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-21028649 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 16:01:12.069877 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-938dd094-2c4a-4dd0-a865-c5254f774ff7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:12.070489 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-938dd094-2c4a-4dd0-a865-c5254f774ff7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:12.077533 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-938dd094-2c4a-4dd0-a865-c5254f774ff7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:12.078012 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-938dd094-2c4a-4dd0-a865-c5254f774ff7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:12.078453 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-938dd094-2c4a-4dd0-a865-c5254f774ff7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:12.079316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-938dd094-2c4a-4dd0-a865-c5254f774ff7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:12.079961 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-938dd094-2c4a-4dd0-a865-c5254f774ff7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:12.080350 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-938dd094-2c4a-4dd0-a865-c5254f774ff7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:12.267668 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-938dd094-2c4a-4dd0-a865-c5254f774ff7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:12.282206 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-938dd094-2c4a-4dd0-a865-c5254f774ff7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1678 microversion: 2.1 time: 0.211571 Aug 26 16:01:12.282206 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 330/648] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:12 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1678 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:12.884719 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ead4a848-b213-448e-91e1-f038a54e0ce1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:12.885332 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ead4a848-b213-448e-91e1-f038a54e0ce1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:12.892711 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ead4a848-b213-448e-91e1-f038a54e0ce1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:12.893196 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ead4a848-b213-448e-91e1-f038a54e0ce1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:12.893634 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ead4a848-b213-448e-91e1-f038a54e0ce1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:12.896384 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ead4a848-b213-448e-91e1-f038a54e0ce1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:12.896384 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ead4a848-b213-448e-91e1-f038a54e0ce1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:12.896384 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ead4a848-b213-448e-91e1-f038a54e0ce1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:12.986030 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.objects.instance [None req-ead4a848-b213-448e-91e1-f038a54e0ce1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lazy-loading 'services' on Instance uuid 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a {{(pid=128304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:01:13.209308 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ead4a848-b213-448e-91e1-f038a54e0ce1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "DELETE /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a/os-volume_attachments/fc38ae63-0f90-4fe5-a819-35260b1179fe" status: 202 len: 0 microversion: 2.1 time: 0.327934 Aug 26 16:01:13.210353 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 319/649] 10.222.0.94 () {58 vars in 1416 bytes} [Fri Aug 26 16:01:12 2022] DELETE /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a/os-volume_attachments/fc38ae63-0f90-4fe5-a819-35260b1179fe => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 16:01:13.219245 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-4fc8d678-b05f-40c1-93b8-c2d6506463f8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:13.221462 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-4fc8d678-b05f-40c1-93b8-c2d6506463f8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:13.233078 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4fc8d678-b05f-40c1-93b8-c2d6506463f8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:13.233864 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4fc8d678-b05f-40c1-93b8-c2d6506463f8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:13.235962 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4fc8d678-b05f-40c1-93b8-c2d6506463f8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:13.236737 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4fc8d678-b05f-40c1-93b8-c2d6506463f8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:13.237272 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4fc8d678-b05f-40c1-93b8-c2d6506463f8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:13.237701 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4fc8d678-b05f-40c1-93b8-c2d6506463f8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:13.271639 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-4fc8d678-b05f-40c1-93b8-c2d6506463f8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056514 Aug 26 16:01:13.272394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 331/650] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:01:13 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:01:13.301905 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-b442e174-bc8a-4665-af92-b7e79ff2ba6c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:13.308873 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-b442e174-bc8a-4665-af92-b7e79ff2ba6c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:13.308873 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b442e174-bc8a-4665-af92-b7e79ff2ba6c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:13.309070 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b442e174-bc8a-4665-af92-b7e79ff2ba6c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:13.309398 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b442e174-bc8a-4665-af92-b7e79ff2ba6c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:13.310665 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b442e174-bc8a-4665-af92-b7e79ff2ba6c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:13.311289 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b442e174-bc8a-4665-af92-b7e79ff2ba6c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:13.311720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b442e174-bc8a-4665-af92-b7e79ff2ba6c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:13.517439 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-b442e174-bc8a-4665-af92-b7e79ff2ba6c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:13.527073 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-b442e174-bc8a-4665-af92-b7e79ff2ba6c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1678 microversion: 2.1 time: 0.229979 Aug 26 16:01:13.528710 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 320/651] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:13 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1678 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:14.286328 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-3b156991-763d-4585-ba69-ab70715c533f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:14.289849 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-3b156991-763d-4585-ba69-ab70715c533f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:14.296964 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3b156991-763d-4585-ba69-ab70715c533f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:14.297445 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3b156991-763d-4585-ba69-ab70715c533f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:14.297875 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3b156991-763d-4585-ba69-ab70715c533f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:14.298574 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3b156991-763d-4585-ba69-ab70715c533f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:14.299048 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3b156991-763d-4585-ba69-ab70715c533f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:14.299469 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3b156991-763d-4585-ba69-ab70715c533f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:14.335119 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-3b156991-763d-4585-ba69-ab70715c533f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053811 Aug 26 16:01:14.335700 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 332/652] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:01:14 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:01:14.553212 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7a1999cb-565d-4e24-a55f-ea2ebb43866d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:14.553799 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-7a1999cb-565d-4e24-a55f-ea2ebb43866d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:14.560791 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7a1999cb-565d-4e24-a55f-ea2ebb43866d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:14.561284 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7a1999cb-565d-4e24-a55f-ea2ebb43866d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:14.561720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7a1999cb-565d-4e24-a55f-ea2ebb43866d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:14.562443 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7a1999cb-565d-4e24-a55f-ea2ebb43866d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:14.567175 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7a1999cb-565d-4e24-a55f-ea2ebb43866d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:14.567175 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7a1999cb-565d-4e24-a55f-ea2ebb43866d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:14.729823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7a1999cb-565d-4e24-a55f-ea2ebb43866d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:14.738600 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-7a1999cb-565d-4e24-a55f-ea2ebb43866d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1678 microversion: 2.1 time: 0.189411 Aug 26 16:01:14.751346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 321/653] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:14 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1678 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:14.774747 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-ae4f5cac-f04f-4796-a4d5-51f56e98dce3 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:14.776703 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-ae4f5cac-f04f-4796-a4d5-51f56e98dce3 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:14.781845 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ae4f5cac-f04f-4796-a4d5-51f56e98dce3 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:14.782463 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ae4f5cac-f04f-4796-a4d5-51f56e98dce3 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:14.782904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ae4f5cac-f04f-4796-a4d5-51f56e98dce3 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:14.783630 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ae4f5cac-f04f-4796-a4d5-51f56e98dce3 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:14.784086 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ae4f5cac-f04f-4796-a4d5-51f56e98dce3 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:14.784530 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ae4f5cac-f04f-4796-a4d5-51f56e98dce3 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:14.872043 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-ae4f5cac-f04f-4796-a4d5-51f56e98dce3 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lazy-loading 'services' on Instance uuid 3e7986b7-b3a1-4529-844e-52a8f7e4e267 {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:01:15.164346 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-ae4f5cac-f04f-4796-a4d5-51f56e98dce3 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "DELETE /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267/os-volume_attachments/9b40593b-279a-40cb-ab51-cd9e87e7ddd7" status: 202 len: 0 microversion: 2.1 time: 0.392844 Aug 26 16:01:15.165093 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 333/654] 10.222.0.94 () {58 vars in 1416 bytes} [Fri Aug 26 16:01:14 2022] DELETE /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267/os-volume_attachments/9b40593b-279a-40cb-ab51-cd9e87e7ddd7 => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 16:01:15.347303 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-9882e79d-0c97-476e-9115-a0d64ffb5b19 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:15.349511 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-9882e79d-0c97-476e-9115-a0d64ffb5b19 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:15.355726 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9882e79d-0c97-476e-9115-a0d64ffb5b19 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:15.356222 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9882e79d-0c97-476e-9115-a0d64ffb5b19 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:15.356653 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9882e79d-0c97-476e-9115-a0d64ffb5b19 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:15.358021 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9882e79d-0c97-476e-9115-a0d64ffb5b19 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:15.358329 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9882e79d-0c97-476e-9115-a0d64ffb5b19 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:15.360313 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9882e79d-0c97-476e-9115-a0d64ffb5b19 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:15.400985 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-9882e79d-0c97-476e-9115-a0d64ffb5b19 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057680 Aug 26 16:01:15.401568 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 322/655] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:01:15 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:01:15.762307 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-24927e8f-7cd8-4559-8b0b-f0d24984d159 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:15.763022 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-24927e8f-7cd8-4559-8b0b-f0d24984d159 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:15.769209 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-24927e8f-7cd8-4559-8b0b-f0d24984d159 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:15.769719 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-24927e8f-7cd8-4559-8b0b-f0d24984d159 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:15.770148 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-24927e8f-7cd8-4559-8b0b-f0d24984d159 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:15.770834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-24927e8f-7cd8-4559-8b0b-f0d24984d159 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:15.771302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-24927e8f-7cd8-4559-8b0b-f0d24984d159 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:15.771716 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-24927e8f-7cd8-4559-8b0b-f0d24984d159 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:15.921087 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-24927e8f-7cd8-4559-8b0b-f0d24984d159 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:15.928816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-24927e8f-7cd8-4559-8b0b-f0d24984d159 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1678 microversion: 2.1 time: 0.170609 Aug 26 16:01:15.929389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 334/656] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:15 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:16.413785 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-14831d98-49d5-4885-87f7-c9848482354b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:16.416127 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-14831d98-49d5-4885-87f7-c9848482354b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:16.424029 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-14831d98-49d5-4885-87f7-c9848482354b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:16.424536 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-14831d98-49d5-4885-87f7-c9848482354b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:16.425055 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-14831d98-49d5-4885-87f7-c9848482354b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:16.425887 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-14831d98-49d5-4885-87f7-c9848482354b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:16.426375 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-14831d98-49d5-4885-87f7-c9848482354b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:16.426878 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-14831d98-49d5-4885-87f7-c9848482354b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:16.464139 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-14831d98-49d5-4885-87f7-c9848482354b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054237 Aug 26 16:01:16.464722 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 323/657] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:01:16 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:01:16.951304 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-cc34e11e-35ad-445a-8460-f95cb23a8aa7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:16.952094 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-cc34e11e-35ad-445a-8460-f95cb23a8aa7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:16.958673 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cc34e11e-35ad-445a-8460-f95cb23a8aa7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:16.959583 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cc34e11e-35ad-445a-8460-f95cb23a8aa7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:16.962203 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cc34e11e-35ad-445a-8460-f95cb23a8aa7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:16.962203 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cc34e11e-35ad-445a-8460-f95cb23a8aa7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:16.962203 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cc34e11e-35ad-445a-8460-f95cb23a8aa7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:16.962203 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cc34e11e-35ad-445a-8460-f95cb23a8aa7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:17.189385 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-cc34e11e-35ad-445a-8460-f95cb23a8aa7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:17.197642 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-cc34e11e-35ad-445a-8460-f95cb23a8aa7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1678 microversion: 2.1 time: 0.251071 Aug 26 16:01:17.198447 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 335/658] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:16 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1678 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:17.479786 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-fb22b301-1fe0-4563-855b-c646da9fbe94 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:17.482492 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-fb22b301-1fe0-4563-855b-c646da9fbe94 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:17.489451 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fb22b301-1fe0-4563-855b-c646da9fbe94 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:17.489928 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fb22b301-1fe0-4563-855b-c646da9fbe94 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:17.490356 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fb22b301-1fe0-4563-855b-c646da9fbe94 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:17.491070 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fb22b301-1fe0-4563-855b-c646da9fbe94 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:17.491518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fb22b301-1fe0-4563-855b-c646da9fbe94 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:17.491936 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fb22b301-1fe0-4563-855b-c646da9fbe94 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:17.524603 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-fb22b301-1fe0-4563-855b-c646da9fbe94 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048690 Aug 26 16:01:17.525175 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 324/659] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:01:17 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:01:17.799094 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-d25497d0-8844-4205-8c02-c99ae9c16bb0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:01:17.801912 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-d25497d0-8844-4205-8c02-c99ae9c16bb0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:17.808433 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d25497d0-8844-4205-8c02-c99ae9c16bb0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:17.809150 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d25497d0-8844-4205-8c02-c99ae9c16bb0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:17.810657 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d25497d0-8844-4205-8c02-c99ae9c16bb0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:17.811753 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d25497d0-8844-4205-8c02-c99ae9c16bb0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:17.812384 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d25497d0-8844-4205-8c02-c99ae9c16bb0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:17.812978 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d25497d0-8844-4205-8c02-c99ae9c16bb0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:17.855515 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-d25497d0-8844-4205-8c02-c99ae9c16bb0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lazy-loading 'flavor' on Instance uuid 842d5015-aa0d-46a5-8162-7201b4277653 {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:01:18.056031 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:01:18.220566 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-37c6bc16-04fe-47c9-a566-1ffe02405e20 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:18.221202 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-37c6bc16-04fe-47c9-a566-1ffe02405e20 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:18.238359 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-37c6bc16-04fe-47c9-a566-1ffe02405e20 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:18.238843 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-37c6bc16-04fe-47c9-a566-1ffe02405e20 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:18.239310 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-37c6bc16-04fe-47c9-a566-1ffe02405e20 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:18.240005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-37c6bc16-04fe-47c9-a566-1ffe02405e20 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:18.240452 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-37c6bc16-04fe-47c9-a566-1ffe02405e20 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:18.240872 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-37c6bc16-04fe-47c9-a566-1ffe02405e20 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:18.353159 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-d25497d0-8844-4205-8c02-c99ae9c16bb0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "POST /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653/action" status: 200 len: 32 microversion: 2.1 time: 0.556592 Aug 26 16:01:18.355912 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 336/660] 10.222.0.94 () {60 vars in 1278 bytes} [Fri Aug 26 16:01:17 2022] POST /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653/action => generated 32 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 16:01:18.368722 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-e2e67a8a-1cf4-4156-9ca6-0176ad2586e5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:18.370212 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-e2e67a8a-1cf4-4156-9ca6-0176ad2586e5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:18.381583 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e2e67a8a-1cf4-4156-9ca6-0176ad2586e5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:18.383571 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e2e67a8a-1cf4-4156-9ca6-0176ad2586e5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:18.384249 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e2e67a8a-1cf4-4156-9ca6-0176ad2586e5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:18.385791 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e2e67a8a-1cf4-4156-9ca6-0176ad2586e5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:18.386793 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e2e67a8a-1cf4-4156-9ca6-0176ad2586e5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:18.387537 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e2e67a8a-1cf4-4156-9ca6-0176ad2586e5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:18.489501 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-37c6bc16-04fe-47c9-a566-1ffe02405e20 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:18.498413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-37c6bc16-04fe-47c9-a566-1ffe02405e20 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1678 microversion: 2.1 time: 0.282315 Aug 26 16:01:18.503096 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 325/661] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:18 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1678 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:01:18.538299 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-fc4e8121-6bd2-4554-8752-ef844ed26527 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:18.543371 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-fc4e8121-6bd2-4554-8752-ef844ed26527 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:18.553275 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fc4e8121-6bd2-4554-8752-ef844ed26527 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:18.553865 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fc4e8121-6bd2-4554-8752-ef844ed26527 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:18.554384 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fc4e8121-6bd2-4554-8752-ef844ed26527 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:18.555203 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fc4e8121-6bd2-4554-8752-ef844ed26527 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:18.555731 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fc4e8121-6bd2-4554-8752-ef844ed26527 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:18.556234 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fc4e8121-6bd2-4554-8752-ef844ed26527 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:18.593318 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-fc4e8121-6bd2-4554-8752-ef844ed26527 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059280 Aug 26 16:01:18.594218 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 326/662] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:01:18 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:01:18.646514 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-e2e67a8a-1cf4-4156-9ca6-0176ad2586e5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:18.655987 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-e2e67a8a-1cf4-4156-9ca6-0176ad2586e5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1735 microversion: 2.1 time: 0.292026 Aug 26 16:01:18.656635 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 337/663] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:18 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1735 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:19.526226 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-0ee20e03-3106-4039-8604-1365a1c92a43 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:19.526848 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-0ee20e03-3106-4039-8604-1365a1c92a43 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:19.568973 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0ee20e03-3106-4039-8604-1365a1c92a43 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:19.569473 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0ee20e03-3106-4039-8604-1365a1c92a43 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:19.569943 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0ee20e03-3106-4039-8604-1365a1c92a43 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:19.578119 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0ee20e03-3106-4039-8604-1365a1c92a43 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:19.578711 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0ee20e03-3106-4039-8604-1365a1c92a43 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:19.588014 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0ee20e03-3106-4039-8604-1365a1c92a43 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:19.606913 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-cfd26fde-9816-4d7e-9c55-232469523cfe tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:19.610910 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-cfd26fde-9816-4d7e-9c55-232469523cfe tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:19.633538 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cfd26fde-9816-4d7e-9c55-232469523cfe tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:19.634035 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cfd26fde-9816-4d7e-9c55-232469523cfe tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:19.635909 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cfd26fde-9816-4d7e-9c55-232469523cfe tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:19.644037 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cfd26fde-9816-4d7e-9c55-232469523cfe tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:19.644579 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cfd26fde-9816-4d7e-9c55-232469523cfe tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:19.645373 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cfd26fde-9816-4d7e-9c55-232469523cfe tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:19.714749 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-cfd26fde-9816-4d7e-9c55-232469523cfe tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.112519 Aug 26 16:01:19.715949 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 338/664] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:01:19 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 16:01:19.729339 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-dd544067-2ffb-413f-82bb-a4741d5bd91c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:19.730137 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-dd544067-2ffb-413f-82bb-a4741d5bd91c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:19.737696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dd544067-2ffb-413f-82bb-a4741d5bd91c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:19.738426 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dd544067-2ffb-413f-82bb-a4741d5bd91c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:19.739212 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dd544067-2ffb-413f-82bb-a4741d5bd91c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:19.740082 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dd544067-2ffb-413f-82bb-a4741d5bd91c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:19.740691 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dd544067-2ffb-413f-82bb-a4741d5bd91c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:19.741296 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-dd544067-2ffb-413f-82bb-a4741d5bd91c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:19.921225 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-0ee20e03-3106-4039-8604-1365a1c92a43 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:19.945368 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-0ee20e03-3106-4039-8604-1365a1c92a43 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1678 microversion: 2.1 time: 0.428300 Aug 26 16:01:19.948095 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 327/665] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:19 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1678 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:19.959836 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-85145386-613e-48a4-bf03-171dc38f745d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:19.966306 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-85145386-613e-48a4-bf03-171dc38f745d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:19.977136 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-85145386-613e-48a4-bf03-171dc38f745d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:19.980660 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-85145386-613e-48a4-bf03-171dc38f745d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:19.981904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-85145386-613e-48a4-bf03-171dc38f745d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:19.984548 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-85145386-613e-48a4-bf03-171dc38f745d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:19.985419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-85145386-613e-48a4-bf03-171dc38f745d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:19.986075 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-85145386-613e-48a4-bf03-171dc38f745d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:20.016157 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-dd544067-2ffb-413f-82bb-a4741d5bd91c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:20.018400 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-85145386-613e-48a4-bf03-171dc38f745d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Going to try to terminate instance {{(pid=128304) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 16:01:20.031545 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-dd544067-2ffb-413f-82bb-a4741d5bd91c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1735 microversion: 2.1 time: 0.314387 Aug 26 16:01:20.032586 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 339/666] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:19 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1735 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:20.375399 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-85145386-613e-48a4-bf03-171dc38f745d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "DELETE /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 204 len: 0 microversion: 2.1 time: 0.424697 Aug 26 16:01:20.376010 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 328/667] 10.222.0.94 () {58 vars in 1239 bytes} [Fri Aug 26 16:01:19 2022] DELETE /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 16:01:20.384294 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-0acdca24-25ed-43e7-8bb3-442bf6c07af1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:20.384895 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-0acdca24-25ed-43e7-8bb3-442bf6c07af1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:20.391657 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0acdca24-25ed-43e7-8bb3-442bf6c07af1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:20.392394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0acdca24-25ed-43e7-8bb3-442bf6c07af1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:20.392764 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0acdca24-25ed-43e7-8bb3-442bf6c07af1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:20.393471 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0acdca24-25ed-43e7-8bb3-442bf6c07af1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:20.393934 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0acdca24-25ed-43e7-8bb3-442bf6c07af1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:20.394359 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0acdca24-25ed-43e7-8bb3-442bf6c07af1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:20.542997 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-0acdca24-25ed-43e7-8bb3-442bf6c07af1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:20.551534 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-0acdca24-25ed-43e7-8bb3-442bf6c07af1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1681 microversion: 2.1 time: 0.170889 Aug 26 16:01:20.552058 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 340/668] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:20 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:20.626437 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-11ab27f0-60ef-41ad-8ed1-b3fc44536768 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:20.627105 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-11ab27f0-60ef-41ad-8ed1-b3fc44536768 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:20.633483 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-11ab27f0-60ef-41ad-8ed1-b3fc44536768 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:20.633973 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-11ab27f0-60ef-41ad-8ed1-b3fc44536768 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:20.634407 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-11ab27f0-60ef-41ad-8ed1-b3fc44536768 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:20.635147 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-11ab27f0-60ef-41ad-8ed1-b3fc44536768 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:20.635600 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-11ab27f0-60ef-41ad-8ed1-b3fc44536768 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:20.636221 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-11ab27f0-60ef-41ad-8ed1-b3fc44536768 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:20.641596 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:01:20.666248 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-11ab27f0-60ef-41ad-8ed1-b3fc44536768 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Going to try to terminate instance {{(pid=128304) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 16:01:20.970021 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-2f27f868-7996-4120-a60f-27199c493257 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:20.970780 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-2f27f868-7996-4120-a60f-27199c493257 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:20.977752 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2f27f868-7996-4120-a60f-27199c493257 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:20.978689 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2f27f868-7996-4120-a60f-27199c493257 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:20.979312 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2f27f868-7996-4120-a60f-27199c493257 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:20.980220 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2f27f868-7996-4120-a60f-27199c493257 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:20.980846 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2f27f868-7996-4120-a60f-27199c493257 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:20.981275 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2f27f868-7996-4120-a60f-27199c493257 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:21.145200 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-11ab27f0-60ef-41ad-8ed1-b3fc44536768 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "DELETE /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267" status: 204 len: 0 microversion: 2.1 time: 0.523523 Aug 26 16:01:21.148779 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-2f27f868-7996-4120-a60f-27199c493257 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:21.150122 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 329/669] 10.222.0.94 () {58 vars in 1239 bytes} [Fri Aug 26 16:01:20 2022] DELETE /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 16:01:21.159689 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-b330d3f6-be1f-47c8-a10f-9184fbdae0c6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:21.160891 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-b330d3f6-be1f-47c8-a10f-9184fbdae0c6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:21.167253 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b330d3f6-be1f-47c8-a10f-9184fbdae0c6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:21.167838 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b330d3f6-be1f-47c8-a10f-9184fbdae0c6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:21.168348 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b330d3f6-be1f-47c8-a10f-9184fbdae0c6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:21.168554 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-2f27f868-7996-4120-a60f-27199c493257 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1678 microversion: 2.1 time: 0.202526 Aug 26 16:01:21.169182 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b330d3f6-be1f-47c8-a10f-9184fbdae0c6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:21.169650 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 341/670] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:20 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1678 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:01:21.170624 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b330d3f6-be1f-47c8-a10f-9184fbdae0c6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:21.171296 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b330d3f6-be1f-47c8-a10f-9184fbdae0c6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:21.177597 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-7702bdfe-35c5-48db-8a8d-2b9aeb363fde tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:21.179202 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-7702bdfe-35c5-48db-8a8d-2b9aeb363fde tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:21.188669 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7702bdfe-35c5-48db-8a8d-2b9aeb363fde tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:21.190336 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7702bdfe-35c5-48db-8a8d-2b9aeb363fde tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:21.192430 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7702bdfe-35c5-48db-8a8d-2b9aeb363fde tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:21.193599 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7702bdfe-35c5-48db-8a8d-2b9aeb363fde tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:21.194246 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7702bdfe-35c5-48db-8a8d-2b9aeb363fde tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:21.195708 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7702bdfe-35c5-48db-8a8d-2b9aeb363fde tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:21.419876 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-b330d3f6-be1f-47c8-a10f-9184fbdae0c6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:21.423276 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-7702bdfe-35c5-48db-8a8d-2b9aeb363fde tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:21.430164 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-b330d3f6-be1f-47c8-a10f-9184fbdae0c6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1735 microversion: 2.1 time: 0.278305 Aug 26 16:01:21.434982 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 330/671] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:21 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1735 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:21.435137 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-7702bdfe-35c5-48db-8a8d-2b9aeb363fde tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267" status: 200 len: 1513 microversion: 2.1 time: 0.259001 Aug 26 16:01:21.435137 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 342/672] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:21 2022] GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 => generated 1513 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:21.582785 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-8c20d84e-e761-4878-a35b-595cc68475c0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:21.583751 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-8c20d84e-e761-4878-a35b-595cc68475c0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:21.592615 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8c20d84e-e761-4878-a35b-595cc68475c0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:21.593696 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8c20d84e-e761-4878-a35b-595cc68475c0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:21.594337 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8c20d84e-e761-4878-a35b-595cc68475c0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:21.595286 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8c20d84e-e761-4878-a35b-595cc68475c0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:21.595911 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8c20d84e-e761-4878-a35b-595cc68475c0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:21.596349 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8c20d84e-e761-4878-a35b-595cc68475c0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:21.810235 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-8c20d84e-e761-4878-a35b-595cc68475c0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:21.819287 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-8c20d84e-e761-4878-a35b-595cc68475c0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1681 microversion: 2.1 time: 0.244136 Aug 26 16:01:21.826198 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 331/673] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:21 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1681 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:22.195816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-7e5124e6-e079-4bfb-a446-22105a3cc556 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:22.196547 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-7e5124e6-e079-4bfb-a446-22105a3cc556 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:22.204723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7e5124e6-e079-4bfb-a446-22105a3cc556 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:22.205308 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7e5124e6-e079-4bfb-a446-22105a3cc556 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:22.205822 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7e5124e6-e079-4bfb-a446-22105a3cc556 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:22.206701 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7e5124e6-e079-4bfb-a446-22105a3cc556 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:22.207420 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7e5124e6-e079-4bfb-a446-22105a3cc556 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:22.207914 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7e5124e6-e079-4bfb-a446-22105a3cc556 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:22.353492 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-7e5124e6-e079-4bfb-a446-22105a3cc556 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:22.362009 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-7e5124e6-e079-4bfb-a446-22105a3cc556 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1678 microversion: 2.1 time: 0.170150 Aug 26 16:01:22.362591 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 343/674] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:22 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:22.456945 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-de4bc2b7-4380-4902-9e34-917a2a4a1776 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:22.457899 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-de4bc2b7-4380-4902-9e34-917a2a4a1776 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:22.461822 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-593dc1b6-0a4d-43ef-a516-6ac5a4b88c56 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:22.462801 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-593dc1b6-0a4d-43ef-a516-6ac5a4b88c56 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:22.473561 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-593dc1b6-0a4d-43ef-a516-6ac5a4b88c56 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:22.474695 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-593dc1b6-0a4d-43ef-a516-6ac5a4b88c56 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:22.475515 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-593dc1b6-0a4d-43ef-a516-6ac5a4b88c56 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:22.476828 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-593dc1b6-0a4d-43ef-a516-6ac5a4b88c56 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:22.477491 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-593dc1b6-0a4d-43ef-a516-6ac5a4b88c56 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:22.478130 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-593dc1b6-0a4d-43ef-a516-6ac5a4b88c56 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:22.481819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-de4bc2b7-4380-4902-9e34-917a2a4a1776 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:22.487533 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-de4bc2b7-4380-4902-9e34-917a2a4a1776 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:22.487533 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-de4bc2b7-4380-4902-9e34-917a2a4a1776 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:22.487533 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-de4bc2b7-4380-4902-9e34-917a2a4a1776 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:22.487533 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-de4bc2b7-4380-4902-9e34-917a2a4a1776 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:22.487870 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-de4bc2b7-4380-4902-9e34-917a2a4a1776 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:22.708975 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-593dc1b6-0a4d-43ef-a516-6ac5a4b88c56 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:22.717538 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-de4bc2b7-4380-4902-9e34-917a2a4a1776 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:22.718247 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-593dc1b6-0a4d-43ef-a516-6ac5a4b88c56 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1735 microversion: 2.1 time: 0.260565 Aug 26 16:01:22.725196 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-de4bc2b7-4380-4902-9e34-917a2a4a1776 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267" status: 200 len: 1513 microversion: 2.1 time: 0.273473 Aug 26 16:01:22.726110 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 332/675] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:22 2022] GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 => generated 1513 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:22.731882 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 344/676] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:22 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1735 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:22.840525 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-52653b13-d70e-4a0e-8b65-17015882976c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:22.841125 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-52653b13-d70e-4a0e-8b65-17015882976c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:22.848159 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-52653b13-d70e-4a0e-8b65-17015882976c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:22.851447 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-52653b13-d70e-4a0e-8b65-17015882976c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:22.852127 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-52653b13-d70e-4a0e-8b65-17015882976c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:22.853063 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-52653b13-d70e-4a0e-8b65-17015882976c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:22.853687 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-52653b13-d70e-4a0e-8b65-17015882976c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:22.854709 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-52653b13-d70e-4a0e-8b65-17015882976c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:23.029560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-52653b13-d70e-4a0e-8b65-17015882976c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:23.038068 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-52653b13-d70e-4a0e-8b65-17015882976c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1681 microversion: 2.1 time: 0.201802 Aug 26 16:01:23.038670 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 333/677] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:22 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1681 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:23.392834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-80187db2-9c01-4e59-bb29-b5bae48249d1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:23.393639 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-80187db2-9c01-4e59-bb29-b5bae48249d1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:23.400799 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-80187db2-9c01-4e59-bb29-b5bae48249d1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:23.401290 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-80187db2-9c01-4e59-bb29-b5bae48249d1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:23.401716 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-80187db2-9c01-4e59-bb29-b5bae48249d1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:23.402522 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-80187db2-9c01-4e59-bb29-b5bae48249d1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:23.403834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-80187db2-9c01-4e59-bb29-b5bae48249d1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:23.411018 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-80187db2-9c01-4e59-bb29-b5bae48249d1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:23.567180 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-80187db2-9c01-4e59-bb29-b5bae48249d1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:23.589898 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-80187db2-9c01-4e59-bb29-b5bae48249d1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1678 microversion: 2.1 time: 0.201936 Aug 26 16:01:23.589898 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 345/678] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:23 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1678 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:23.740252 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-42f27c5e-0580-4ac0-879a-3838a2288cf1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:23.740866 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-42f27c5e-0580-4ac0-879a-3838a2288cf1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:23.746484 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-0bc42a5e-cec7-408e-bfb0-e68bbd38d7af tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:23.747162 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-0bc42a5e-cec7-408e-bfb0-e68bbd38d7af tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:23.748718 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42f27c5e-0580-4ac0-879a-3838a2288cf1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:23.749267 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42f27c5e-0580-4ac0-879a-3838a2288cf1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:23.749710 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42f27c5e-0580-4ac0-879a-3838a2288cf1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:23.750425 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42f27c5e-0580-4ac0-879a-3838a2288cf1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:23.750882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42f27c5e-0580-4ac0-879a-3838a2288cf1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:23.751348 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42f27c5e-0580-4ac0-879a-3838a2288cf1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:23.753131 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0bc42a5e-cec7-408e-bfb0-e68bbd38d7af tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:23.753627 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0bc42a5e-cec7-408e-bfb0-e68bbd38d7af tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:23.754222 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0bc42a5e-cec7-408e-bfb0-e68bbd38d7af tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:23.754940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0bc42a5e-cec7-408e-bfb0-e68bbd38d7af tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:23.755429 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0bc42a5e-cec7-408e-bfb0-e68bbd38d7af tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:23.755853 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0bc42a5e-cec7-408e-bfb0-e68bbd38d7af tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:23.968218 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-42f27c5e-0580-4ac0-879a-3838a2288cf1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:23.972857 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-0bc42a5e-cec7-408e-bfb0-e68bbd38d7af tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:23.977647 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-42f27c5e-0580-4ac0-879a-3838a2288cf1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1735 microversion: 2.1 time: 0.241107 Aug 26 16:01:23.978703 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 334/679] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:23 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1735 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:23.988014 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-0bc42a5e-cec7-408e-bfb0-e68bbd38d7af tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267" status: 200 len: 1513 microversion: 2.1 time: 0.238695 Aug 26 16:01:23.988014 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 346/680] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:23 2022] GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 => generated 1513 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:01:24.063449 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-f6d7d9f6-2da4-49a1-af2a-dc4d137bbedf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:24.064175 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-f6d7d9f6-2da4-49a1-af2a-dc4d137bbedf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:24.075327 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f6d7d9f6-2da4-49a1-af2a-dc4d137bbedf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:24.076129 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f6d7d9f6-2da4-49a1-af2a-dc4d137bbedf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:24.077104 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f6d7d9f6-2da4-49a1-af2a-dc4d137bbedf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:24.077825 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f6d7d9f6-2da4-49a1-af2a-dc4d137bbedf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:24.078468 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f6d7d9f6-2da4-49a1-af2a-dc4d137bbedf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:24.078895 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f6d7d9f6-2da4-49a1-af2a-dc4d137bbedf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:24.231765 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-f6d7d9f6-2da4-49a1-af2a-dc4d137bbedf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:24.239570 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-f6d7d9f6-2da4-49a1-af2a-dc4d137bbedf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1681 microversion: 2.1 time: 0.182055 Aug 26 16:01:24.244645 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 347/681] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:24 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:24.603515 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f25bbf51-2c6d-47cd-a6e1-cbf371937a7d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:24.604124 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-f25bbf51-2c6d-47cd-a6e1-cbf371937a7d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:24.610562 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f25bbf51-2c6d-47cd-a6e1-cbf371937a7d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:24.611080 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f25bbf51-2c6d-47cd-a6e1-cbf371937a7d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:24.611524 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f25bbf51-2c6d-47cd-a6e1-cbf371937a7d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:24.612217 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f25bbf51-2c6d-47cd-a6e1-cbf371937a7d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:24.612667 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f25bbf51-2c6d-47cd-a6e1-cbf371937a7d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:24.613112 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f25bbf51-2c6d-47cd-a6e1-cbf371937a7d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:24.771461 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-f25bbf51-2c6d-47cd-a6e1-cbf371937a7d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:24.780064 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-f25bbf51-2c6d-47cd-a6e1-cbf371937a7d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1678 microversion: 2.1 time: 0.180392 Aug 26 16:01:24.780955 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 335/682] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:24 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1678 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:25.003303 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-8e5bfaee-2116-447a-b2b4-227cc1330be0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:25.008604 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-75600107-26a1-4aeb-8edb-91953925e5c1 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:25.008604 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-75600107-26a1-4aeb-8edb-91953925e5c1 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:25.010665 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-8e5bfaee-2116-447a-b2b4-227cc1330be0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:25.019869 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8e5bfaee-2116-447a-b2b4-227cc1330be0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:25.020132 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-75600107-26a1-4aeb-8edb-91953925e5c1 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:25.020788 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8e5bfaee-2116-447a-b2b4-227cc1330be0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:25.021345 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-75600107-26a1-4aeb-8edb-91953925e5c1 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:25.021929 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8e5bfaee-2116-447a-b2b4-227cc1330be0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:25.022151 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-75600107-26a1-4aeb-8edb-91953925e5c1 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:25.023488 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8e5bfaee-2116-447a-b2b4-227cc1330be0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:25.023785 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-75600107-26a1-4aeb-8edb-91953925e5c1 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:25.024356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8e5bfaee-2116-447a-b2b4-227cc1330be0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:25.024486 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-75600107-26a1-4aeb-8edb-91953925e5c1 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:25.024973 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-75600107-26a1-4aeb-8edb-91953925e5c1 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:25.025537 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8e5bfaee-2116-447a-b2b4-227cc1330be0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:25.523043 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-75600107-26a1-4aeb-8edb-91953925e5c1 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:25.541851 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-75600107-26a1-4aeb-8edb-91953925e5c1 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267" status: 200 len: 1513 microversion: 2.1 time: 0.542764 Aug 26 16:01:25.543466 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 336/683] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:24 2022] GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 => generated 1513 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:25.555721 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-b97b2034-ccab-41fe-985d-4d8f10c180c0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:25.558319 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-b97b2034-ccab-41fe-985d-4d8f10c180c0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:25.592561 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b97b2034-ccab-41fe-985d-4d8f10c180c0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:25.593057 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b97b2034-ccab-41fe-985d-4d8f10c180c0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:25.593527 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b97b2034-ccab-41fe-985d-4d8f10c180c0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:25.594542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b97b2034-ccab-41fe-985d-4d8f10c180c0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:25.595192 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b97b2034-ccab-41fe-985d-4d8f10c180c0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:25.595788 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b97b2034-ccab-41fe-985d-4d8f10c180c0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:25.615223 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-8e5bfaee-2116-447a-b2b4-227cc1330be0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:25.652710 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-8e5bfaee-2116-447a-b2b4-227cc1330be0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1735 microversion: 2.1 time: 0.654897 Aug 26 16:01:25.654378 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 348/684] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:24 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1735 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:25.803904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-b37ef4d2-6805-4960-9d16-1877ff45e500 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:25.806124 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-b37ef4d2-6805-4960-9d16-1877ff45e500 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:25.816463 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b37ef4d2-6805-4960-9d16-1877ff45e500 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:25.817326 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b37ef4d2-6805-4960-9d16-1877ff45e500 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:25.817936 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b37ef4d2-6805-4960-9d16-1877ff45e500 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:25.818653 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b37ef4d2-6805-4960-9d16-1877ff45e500 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:25.819287 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b37ef4d2-6805-4960-9d16-1877ff45e500 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:25.819720 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b37ef4d2-6805-4960-9d16-1877ff45e500 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:25.987557 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-b97b2034-ccab-41fe-985d-4d8f10c180c0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:25.999106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-b97b2034-ccab-41fe-985d-4d8f10c180c0 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1681 microversion: 2.1 time: 0.453251 Aug 26 16:01:26.011053 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 337/685] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:25 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1681 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:26.117098 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b37ef4d2-6805-4960-9d16-1877ff45e500 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:26.144877 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-b37ef4d2-6805-4960-9d16-1877ff45e500 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1678 microversion: 2.1 time: 0.344840 Aug 26 16:01:26.145502 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 349/686] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:25 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1678 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:26.336051 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-cf84bd3a-9b21-4b05-b578-0ddbe792fa1d req-fb5ea914-9ae7-478e-aeed-508b502b5f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e7986b7-b3a1-4529-844e-52a8f7e4e267", "name": "network-vif-deleted", "tag": "e5492052-f3ca-4f03-a11d-4f492a9b75db"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:01:26.351990 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-cf84bd3a-9b21-4b05-b578-0ddbe792fa1d req-fb5ea914-9ae7-478e-aeed-508b502b5f54 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:26.352970 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-cf84bd3a-9b21-4b05-b578-0ddbe792fa1d req-fb5ea914-9ae7-478e-aeed-508b502b5f54 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:26.353627 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-cf84bd3a-9b21-4b05-b578-0ddbe792fa1d req-fb5ea914-9ae7-478e-aeed-508b502b5f54 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:26.394141 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-cf84bd3a-9b21-4b05-b578-0ddbe792fa1d req-fb5ea914-9ae7-478e-aeed-508b502b5f54 service nova] Creating event network-vif-deleted:e5492052-f3ca-4f03-a11d-4f492a9b75db for instance 3e7986b7-b3a1-4529-844e-52a8f7e4e267 on hv-cinder-85144 Aug 26 16:01:26.406020 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-cf84bd3a-9b21-4b05-b578-0ddbe792fa1d req-fb5ea914-9ae7-478e-aeed-508b502b5f54 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069265 Aug 26 16:01:26.407931 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 338/687] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:01:26.564113 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-959e91dc-a505-465e-ae67-bea8eea5223b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:26.565021 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-959e91dc-a505-465e-ae67-bea8eea5223b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:26.579414 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-959e91dc-a505-465e-ae67-bea8eea5223b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:26.579822 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-959e91dc-a505-465e-ae67-bea8eea5223b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:26.580251 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-959e91dc-a505-465e-ae67-bea8eea5223b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:26.580959 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-959e91dc-a505-465e-ae67-bea8eea5223b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:26.581403 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-959e91dc-a505-465e-ae67-bea8eea5223b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:26.583966 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-959e91dc-a505-465e-ae67-bea8eea5223b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:26.677647 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-b4fe014f-b346-4b54-9a99-cd32e98e9178 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:26.680821 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-b4fe014f-b346-4b54-9a99-cd32e98e9178 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:26.699311 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b4fe014f-b346-4b54-9a99-cd32e98e9178 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:26.700653 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b4fe014f-b346-4b54-9a99-cd32e98e9178 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:26.703153 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b4fe014f-b346-4b54-9a99-cd32e98e9178 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:26.704200 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b4fe014f-b346-4b54-9a99-cd32e98e9178 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:26.706553 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b4fe014f-b346-4b54-9a99-cd32e98e9178 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:26.708037 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b4fe014f-b346-4b54-9a99-cd32e98e9178 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:26.762525 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-959e91dc-a505-465e-ae67-bea8eea5223b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:26.787737 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-959e91dc-a505-465e-ae67-bea8eea5223b tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267" status: 200 len: 1304 microversion: 2.1 time: 0.228402 Aug 26 16:01:26.793577 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 350/688] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:26 2022] GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 => generated 1304 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:27.000476 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-b4fe014f-b346-4b54-9a99-cd32e98e9178 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:27.013995 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-b4fe014f-b346-4b54-9a99-cd32e98e9178 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1735 microversion: 2.1 time: 0.341724 Aug 26 16:01:27.022240 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 339/689] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:26 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1735 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:27.028890 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-c79a2c1b-e078-457d-b366-f7b0fcb133d1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:27.047825 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-c79a2c1b-e078-457d-b366-f7b0fcb133d1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:27.047825 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c79a2c1b-e078-457d-b366-f7b0fcb133d1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:27.047825 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c79a2c1b-e078-457d-b366-f7b0fcb133d1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:27.047825 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c79a2c1b-e078-457d-b366-f7b0fcb133d1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:27.049321 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c79a2c1b-e078-457d-b366-f7b0fcb133d1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:27.049321 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c79a2c1b-e078-457d-b366-f7b0fcb133d1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:27.049321 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c79a2c1b-e078-457d-b366-f7b0fcb133d1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:27.168342 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-d119738b-8048-447f-8b73-57d306f12c54 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:27.169191 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-d119738b-8048-447f-8b73-57d306f12c54 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:27.187670 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d119738b-8048-447f-8b73-57d306f12c54 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:27.188644 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d119738b-8048-447f-8b73-57d306f12c54 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:27.198643 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d119738b-8048-447f-8b73-57d306f12c54 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:27.199441 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d119738b-8048-447f-8b73-57d306f12c54 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:27.200101 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d119738b-8048-447f-8b73-57d306f12c54 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:27.200726 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d119738b-8048-447f-8b73-57d306f12c54 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:27.288743 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-c79a2c1b-e078-457d-b366-f7b0fcb133d1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:27.303419 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-c79a2c1b-e078-457d-b366-f7b0fcb133d1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1614 microversion: 2.1 time: 0.276133 Aug 26 16:01:27.305405 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 351/690] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:27 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1614 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:27.463147 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-d119738b-8048-447f-8b73-57d306f12c54 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:27.472451 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-d119738b-8048-447f-8b73-57d306f12c54 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1678 microversion: 2.1 time: 0.307929 Aug 26 16:01:27.473650 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 340/691] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:27 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1678 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:27.811537 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-8620df60-7736-4f1c-8fda-a35b8156e380 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:27.812166 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-8620df60-7736-4f1c-8fda-a35b8156e380 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:27.823169 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8620df60-7736-4f1c-8fda-a35b8156e380 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:27.823663 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8620df60-7736-4f1c-8fda-a35b8156e380 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:27.826111 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8620df60-7736-4f1c-8fda-a35b8156e380 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:27.827109 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8620df60-7736-4f1c-8fda-a35b8156e380 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:27.827920 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8620df60-7736-4f1c-8fda-a35b8156e380 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:27.828766 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8620df60-7736-4f1c-8fda-a35b8156e380 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:27.851107 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:01:27.871540 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8620df60-7736-4f1c-8fda-a35b8156e380 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:27.872073 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8620df60-7736-4f1c-8fda-a35b8156e380 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:27.872523 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8620df60-7736-4f1c-8fda-a35b8156e380 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:27.873679 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-8620df60-7736-4f1c-8fda-a35b8156e380 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lazy-loading 'fault' on Instance uuid 3e7986b7-b3a1-4529-844e-52a8f7e4e267 {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:01:27.948324 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-8620df60-7736-4f1c-8fda-a35b8156e380 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0ecfd3d64ba4fef820a31b1522125ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a9b259e9d54603af734306adbfe16c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:27.963479 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-8620df60-7736-4f1c-8fda-a35b8156e380 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267" status: 200 len: 1309 microversion: 2.1 time: 0.157863 Aug 26 16:01:27.968624 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 352/692] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:27 2022] GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 => generated 1309 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:28.037141 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-2536ec23-0a7f-497d-9c8f-cd4c71494c13 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:28.037763 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-2536ec23-0a7f-497d-9c8f-cd4c71494c13 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:28.047603 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2536ec23-0a7f-497d-9c8f-cd4c71494c13 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:28.048105 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2536ec23-0a7f-497d-9c8f-cd4c71494c13 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:28.048555 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2536ec23-0a7f-497d-9c8f-cd4c71494c13 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:28.049277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2536ec23-0a7f-497d-9c8f-cd4c71494c13 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:28.049740 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2536ec23-0a7f-497d-9c8f-cd4c71494c13 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:28.050172 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2536ec23-0a7f-497d-9c8f-cd4c71494c13 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:28.269397 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-2536ec23-0a7f-497d-9c8f-cd4c71494c13 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:28.282317 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-2536ec23-0a7f-497d-9c8f-cd4c71494c13 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1735 microversion: 2.1 time: 0.248989 Aug 26 16:01:28.282896 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 341/693] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:28 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1735 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:28.331224 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-f7c09998-33c0-4c79-96b2-b833e6ee42f8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:28.331828 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-f7c09998-33c0-4c79-96b2-b833e6ee42f8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:28.349327 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f7c09998-33c0-4c79-96b2-b833e6ee42f8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:28.349944 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f7c09998-33c0-4c79-96b2-b833e6ee42f8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:28.350398 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f7c09998-33c0-4c79-96b2-b833e6ee42f8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:28.351149 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f7c09998-33c0-4c79-96b2-b833e6ee42f8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:28.351605 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f7c09998-33c0-4c79-96b2-b833e6ee42f8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:28.352031 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f7c09998-33c0-4c79-96b2-b833e6ee42f8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:28.436164 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-41437fc4-6c94-4354-a84f-7f0c99be4820 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1978667538", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1225209664", "security_groups": [{"name": "tempest-secgroup-smoke-487351099"}], "networks": [{"uuid": "480b0db0-c679-4bc9-a2ae-d80050879570"}], "block_device_mapping_v2": [{"uuid": "a8abd65c-a268-4e06-8f3d-42b040590c7b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:01:28.439480 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f7c09998-33c0-4c79-96b2-b833e6ee42f8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:28.439976 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f7c09998-33c0-4c79-96b2-b833e6ee42f8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:28.440423 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f7c09998-33c0-4c79-96b2-b833e6ee42f8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:28.444578 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-f7c09998-33c0-4c79-96b2-b833e6ee42f8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lazy-loading 'fault' on Instance uuid 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:01:28.541328 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-f7c09998-33c0-4c79-96b2-b833e6ee42f8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:28.553107 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-f7c09998-33c0-4c79-96b2-b833e6ee42f8 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 200 len: 1332 microversion: 2.1 time: 0.227000 Aug 26 16:01:28.556101 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 353/694] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:28 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 1332 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:28.561727 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-67667237-18de-4f45-9f44-dd483434bcff req-9ead2aaa-1db0-4656-b8fa-f836c47edca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6103553d-b9c7-4ab7-aef1-3fd676bb0a8a", "name": "network-vif-deleted", "tag": "c3d450c2-3d49-40aa-b88c-475438ac1fcc"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:01:28.583703 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-67667237-18de-4f45-9f44-dd483434bcff req-9ead2aaa-1db0-4656-b8fa-f836c47edca3 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:28.583703 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-67667237-18de-4f45-9f44-dd483434bcff req-9ead2aaa-1db0-4656-b8fa-f836c47edca3 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:28.583703 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-67667237-18de-4f45-9f44-dd483434bcff req-9ead2aaa-1db0-4656-b8fa-f836c47edca3 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:28.606009 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-67667237-18de-4f45-9f44-dd483434bcff req-9ead2aaa-1db0-4656-b8fa-f836c47edca3 service nova] Creating event network-vif-deleted:c3d450c2-3d49-40aa-b88c-475438ac1fcc for instance 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a on hv-cinder-85144 Aug 26 16:01:28.612912 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-67667237-18de-4f45-9f44-dd483434bcff req-9ead2aaa-1db0-4656-b8fa-f836c47edca3 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055197 Aug 26 16:01:28.613919 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 354/695] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:01:28.641797 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-f4e412b9-d80c-4cea-87ab-148162983d42 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:28.642837 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-f4e412b9-d80c-4cea-87ab-148162983d42 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:28.651575 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f4e412b9-d80c-4cea-87ab-148162983d42 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:28.652650 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f4e412b9-d80c-4cea-87ab-148162983d42 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:28.653341 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f4e412b9-d80c-4cea-87ab-148162983d42 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:28.656238 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f4e412b9-d80c-4cea-87ab-148162983d42 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:28.656591 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f4e412b9-d80c-4cea-87ab-148162983d42 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:28.657099 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f4e412b9-d80c-4cea-87ab-148162983d42 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:28.731811 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.network.neutron [None req-41437fc4-6c94-4354-a84f-7f0c99be4820 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] validate_networks() for [('480b0db0-c679-4bc9-a2ae-d80050879570', None, None, None, None, None)] {{(pid=128304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 16:01:28.939763 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-f4e412b9-d80c-4cea-87ab-148162983d42 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:28.952801 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-f4e412b9-d80c-4cea-87ab-148162983d42 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1655 microversion: 2.1 time: 0.322178 Aug 26 16:01:28.954720 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 355/696] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:28 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1655 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:28.974413 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-9fbac2cc-b699-4d4c-8a10-dae47d1ea92b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:01:28.982011 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9fbac2cc-b699-4d4c-8a10-dae47d1ea92b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:28.982795 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9fbac2cc-b699-4d4c-8a10-dae47d1ea92b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:28.988697 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9fbac2cc-b699-4d4c-8a10-dae47d1ea92b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:29.021862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-9fbac2cc-b699-4d4c-8a10-dae47d1ea92b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Going to try to start instance {{(pid=128305) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 26 16:01:29.269744 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-9fbac2cc-b699-4d4c-8a10-dae47d1ea92b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "POST /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e/action" status: 202 len: 0 microversion: 2.1 time: 0.298824 Aug 26 16:01:29.275537 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 356/697] 10.222.0.94 () {60 vars in 1278 bytes} [Fri Aug 26 16:01:28 2022] POST /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 16:01:29.286266 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-71def9bf-263e-4c05-9e78-b74cfc2a0da6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:29.287259 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-71def9bf-263e-4c05-9e78-b74cfc2a0da6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] [instance: 3e7986b7-b3a1-4529-844e-52a8f7e4e267] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:29.297020 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-71def9bf-263e-4c05-9e78-b74cfc2a0da6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:29.298110 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-71def9bf-263e-4c05-9e78-b74cfc2a0da6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:29.298777 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-71def9bf-263e-4c05-9e78-b74cfc2a0da6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:29.299915 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-71def9bf-263e-4c05-9e78-b74cfc2a0da6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:29.300605 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-71def9bf-263e-4c05-9e78-b74cfc2a0da6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:29.301526 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-71def9bf-263e-4c05-9e78-b74cfc2a0da6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:29.306844 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-41437fc4-6c94-4354-a84f-7f0c99be4820 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Flavor limits 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 16:01:29.306844 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-41437fc4-6c94-4354-a84f-7f0c99be4820 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Image limits 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 16:01:29.307407 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-41437fc4-6c94-4354-a84f-7f0c99be4820 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Flavor pref 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 16:01:29.307588 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-41437fc4-6c94-4354-a84f-7f0c99be4820 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Image pref 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 16:01:29.308064 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-41437fc4-6c94-4354-a84f-7f0c99be4820 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 16:01:29.314381 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:01:29.318147 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.wsgi [None req-71def9bf-263e-4c05-9e78-b74cfc2a0da6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] HTTP exception thrown: Instance 3e7986b7-b3a1-4529-844e-52a8f7e4e267 could not be found. Aug 26 16:01:29.320145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-71def9bf-263e-4c05-9e78-b74cfc2a0da6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Request method failure captured: Aug 26 16:01:29.320145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: request: GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 HTTP/1.1 Aug 26 16:01:29.320145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept: application/json Aug 26 16:01:29.320145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept-Encoding: identity Aug 26 16:01:29.320145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Connection: close Aug 26 16:01:29.320145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Length: 0 Aug 26 16:01:29.320145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Type: application/json Aug 26 16:01:29.320145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Host: 10.222.0.94 Aug 26 16:01:29.320145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Openstack-System-Scope: None Aug 26 16:01:29.320145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: User-Agent: python-urllib3/1.26.11 Aug 26 16:01:29.320145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Auth-Token: gAAAAABjCO2bvQquYx-QX9opNL3-SuDBzWubsZ7aYjlAcGjZhJmncuoj2SPrDL-rg88gtwHZXEvLy78CnCsRedQbRhOjYj-SqTvrv7vdI5JGn1h9gtzgFFf-QDCRWGPW-hRE0tWN_xLit_qUDPyNo6XcjlkqVrQc5SpCcJ0L1lqTy-4-vjl4Bno Aug 26 16:01:29.320145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Id: None Aug 26 16:01:29.320145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Name: None Aug 26 16:01:29.320145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Identity-Status: Confirmed Aug 26 16:01:29.320145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Is-Admin-Project: True Aug 26 16:01:29.320145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Id: default Aug 26 16:01:29.320145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Name: Default Aug 26 16:01:29.320145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Id: f3a9b259e9d54603af734306adbfe16c Aug 26 16:01:29.320145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1260948601 Aug 26 16:01:29.320145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Role: member,reader Aug 26 16:01:29.320145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Roles: member,reader Aug 26 16:01:29.321520 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/f3a9b259e9d54603af734306adbfe16c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/f3a9b259e9d54603af734306adbfe16c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/f3a9b259e9d54603af734306adbfe16c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_f3a9b259e9d54603af734306adbfe16c", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:01:29.321520 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant: tempest-VolumesSnapshotTestJSON-1260948601 Aug 26 16:01:29.321520 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Id: f3a9b259e9d54603af734306adbfe16c Aug 26 16:01:29.321520 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1260948601 Aug 26 16:01:29.321520 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User: tempest-VolumesSnapshotTestJSON-1260948601-project Aug 26 16:01:29.321520 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Id: default Aug 26 16:01:29.321520 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Name: Default Aug 26 16:01:29.321520 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Id: a0ecfd3d64ba4fef820a31b1522125ff Aug 26 16:01:29.321520 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Name: tempest-VolumesSnapshotTestJSON-1260948601-project Aug 26 16:01:29.321520 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: method: > Aug 26 16:01:29.321520 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: exception: Instance 3e7986b7-b3a1-4529-844e-52a8f7e4e267 could not be found. Aug 26 16:01:29.321520 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: action_args: {'id': '3e7986b7-b3a1-4529-844e-52a8f7e4e267'} Aug 26 16:01:29.322620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:01:29.322620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:29.322620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:01:29.322620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:01:29.322620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:01:29.322620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:01:29.322620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:01:29.322620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:01:29.322620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:01:29.322620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:01:29.322620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e7986b7-b3a1-4529-844e-52a8f7e4e267 could not be found. Aug 26 16:01:29.322620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:01:29.322620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:01:29.322620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:01:29.322620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:29.322620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:01:29.322620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:01:29.322620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:01:29.322620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:01:29.322620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:01:29.323910 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:01:29.323910 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:01:29.323910 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:01:29.323910 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:01:29.323910 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:01:29.323910 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:01:29.323910 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:01:29.323910 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e7986b7-b3a1-4529-844e-52a8f7e4e267 could not be found. Aug 26 16:01:29.323910 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:01:29.323910 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:01:29.323910 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:01:29.323910 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:29.323910 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:01:29.323910 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:01:29.323910 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:01:29.323910 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:01:29.323910 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e7986b7-b3a1-4529-844e-52a8f7e4e267 could not be found. Aug 26 16:01:29.323910 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:01:29.325002 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-71def9bf-263e-4c05-9e78-b74cfc2a0da6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] Returning 404 to user: Instance 3e7986b7-b3a1-4529-844e-52a8f7e4e267 could not be found. {{(pid=128305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:01:29.325002 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-71def9bf-263e-4c05-9e78-b74cfc2a0da6 tempest-VolumesSnapshotTestJSON-1260948601 tempest-VolumesSnapshotTestJSON-1260948601-project] 10.222.0.94 "GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267" status: 404 len: 111 microversion: 2.1 time: 0.044729 Aug 26 16:01:29.326800 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 357/698] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:29 2022] GET /compute/v2.1/servers/3e7986b7-b3a1-4529-844e-52a8f7e4e267 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:01:29.328686 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-41437fc4-6c94-4354-a84f-7f0c99be4820 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:29.329412 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-41437fc4-6c94-4354-a84f-7f0c99be4820 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:29.330164 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-41437fc4-6c94-4354-a84f-7f0c99be4820 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:29.331151 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-41437fc4-6c94-4354-a84f-7f0c99be4820 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:29.331840 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-41437fc4-6c94-4354-a84f-7f0c99be4820 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:29.332580 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-41437fc4-6c94-4354-a84f-7f0c99be4820 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:29.348920 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-24a58c08-017a-4104-a06f-43550ba400b8 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:29.351908 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-24a58c08-017a-4104-a06f-43550ba400b8 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:29.356746 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-41437fc4-6c94-4354-a84f-7f0c99be4820 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Getting quotas for project ea82b722416a415393ff78428a277a01. Resources: {'instances', 'ram', 'cores'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 16:01:29.362725 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-41437fc4-6c94-4354-a84f-7f0c99be4820 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Getting quotas for user 3b3abcfcc7c6408994e27b7c9937c2be and project ea82b722416a415393ff78428a277a01. Resources: {'instances', 'ram', 'cores'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 16:01:29.376121 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-24a58c08-017a-4104-a06f-43550ba400b8 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:29.376795 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-24a58c08-017a-4104-a06f-43550ba400b8 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:29.377254 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-24a58c08-017a-4104-a06f-43550ba400b8 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:29.377985 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-24a58c08-017a-4104-a06f-43550ba400b8 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:29.378440 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-24a58c08-017a-4104-a06f-43550ba400b8 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:29.378861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-24a58c08-017a-4104-a06f-43550ba400b8 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:29.501858 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-41437fc4-6c94-4354-a84f-7f0c99be4820 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Going to run 1 instances... {{(pid=128304) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 16:01:29.504634 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-41437fc4-6c94-4354-a84f-7f0c99be4820 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a8abd65c-a268-4e06-8f3d-42b040590c7b',volume_size=None,volume_type=None)] {{(pid=128304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 16:01:30.014823 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-24a58c08-017a-4104-a06f-43550ba400b8 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:30.024816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-24a58c08-017a-4104-a06f-43550ba400b8 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1664 microversion: 2.1 time: 0.695778 Aug 26 16:01:30.025601 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 358/699] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:29 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1664 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:30.046444 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-feff9518-f8e2-49b9-a844-8005c2f15e04 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:30.047388 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-feff9518-f8e2-49b9-a844-8005c2f15e04 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:30.056251 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-41437fc4-6c94-4354-a84f-7f0c99be4820 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.623927 Aug 26 16:01:30.057372 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 342/700] 10.222.0.94 () {60 vars in 1147 bytes} [Fri Aug 26 16:01:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 1626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 16:01:30.068138 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-42a43b68-943e-49d9-ae9d-c6972e698499 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:30.068759 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-42a43b68-943e-49d9-ae9d-c6972e698499 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:30.070544 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-feff9518-f8e2-49b9-a844-8005c2f15e04 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:30.072188 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-feff9518-f8e2-49b9-a844-8005c2f15e04 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:30.074870 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-feff9518-f8e2-49b9-a844-8005c2f15e04 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:30.075193 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42a43b68-943e-49d9-ae9d-c6972e698499 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:30.075683 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42a43b68-943e-49d9-ae9d-c6972e698499 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:30.076288 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42a43b68-943e-49d9-ae9d-c6972e698499 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:30.076814 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-feff9518-f8e2-49b9-a844-8005c2f15e04 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:30.077220 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42a43b68-943e-49d9-ae9d-c6972e698499 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:30.077690 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42a43b68-943e-49d9-ae9d-c6972e698499 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:30.078116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42a43b68-943e-49d9-ae9d-c6972e698499 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:30.079067 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-feff9518-f8e2-49b9-a844-8005c2f15e04 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:30.082177 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-feff9518-f8e2-49b9-a844-8005c2f15e04 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:30.094689 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-42a43b68-943e-49d9-ae9d-c6972e698499 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] HTTP exception thrown: Instance 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a could not be found. Aug 26 16:01:30.096737 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-42a43b68-943e-49d9-ae9d-c6972e698499 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Request method failure captured: Aug 26 16:01:30.096737 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a HTTP/1.1 Aug 26 16:01:30.096737 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 16:01:30.096737 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 16:01:30.096737 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 16:01:30.096737 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 0 Aug 26 16:01:30.096737 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 16:01:30.096737 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 16:01:30.096737 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 16:01:30.096737 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 16:01:30.096737 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO074Vk8Knkkyah_6hQlXk9FvzAhBqPeYMng3gGU-fQ_qYYEN-UvSDuAz2OG4j3gRVAyM63Qk6cGXT3e_LJrqtVIQ2Wh_rCIb7SpxdZF5G6vc_eR0N-2MIzlwTSdPywpn1m7Hkaqaj-3SiKQy1JcwWLQlfAR9RAjH6drO8qCv3BIADQ Aug 26 16:01:30.096737 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 16:01:30.096737 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 16:01:30.096737 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 16:01:30.096737 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 16:01:30.096737 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 16:01:30.096737 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 16:01:30.096737 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: d95f731096d74a089f4161f5db69280c Aug 26 16:01:30.096737 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:01:30.096737 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 16:01:30.096737 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 16:01:30.098264 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/d95f731096d74a089f4161f5db69280c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/d95f731096d74a089f4161f5db69280c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/d95f731096d74a089f4161f5db69280c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_d95f731096d74a089f4161f5db69280c", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:01:30.098264 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:01:30.098264 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: d95f731096d74a089f4161f5db69280c Aug 26 16:01:30.098264 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:01:30.098264 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-AttachVolumeNegativeTest-243089979-project Aug 26 16:01:30.098264 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 16:01:30.098264 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 16:01:30.098264 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: b50041d36b0b430badd6442a2f09f063 Aug 26 16:01:30.098264 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-AttachVolumeNegativeTest-243089979-project Aug 26 16:01:30.098264 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: > Aug 26 16:01:30.098264 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Instance 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a could not be found. Aug 26 16:01:30.098264 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'id': '6103553d-b9c7-4ab7-aef1-3fd676bb0a8a'} Aug 26 16:01:30.099689 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:01:30.099689 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:30.099689 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:01:30.099689 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:01:30.099689 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:01:30.099689 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:01:30.099689 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:01:30.099689 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:01:30.099689 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:01:30.099689 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:01:30.099689 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a could not be found. Aug 26 16:01:30.099689 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:01:30.099689 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:01:30.099689 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:01:30.099689 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:30.099689 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:01:30.099689 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:01:30.099689 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:01:30.099689 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:01:30.099689 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:01:30.101150 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:01:30.101150 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:01:30.101150 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:01:30.101150 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:01:30.101150 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:01:30.101150 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:01:30.101150 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:01:30.101150 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a could not be found. Aug 26 16:01:30.101150 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:01:30.101150 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:01:30.101150 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:01:30.101150 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:30.101150 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:01:30.101150 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:01:30.101150 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:01:30.101150 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:01:30.101150 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a could not be found. Aug 26 16:01:30.101150 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:01:30.102621 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-42a43b68-943e-49d9-ae9d-c6972e698499 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Returning 404 to user: Instance 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a could not be found. {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:01:30.102621 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-42a43b68-943e-49d9-ae9d-c6972e698499 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 404 len: 111 microversion: 2.1 time: 0.039573 Aug 26 16:01:30.102621 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 343/701] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:30 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:01:30.119541 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ee40379e-5afd-4a64-b9b7-1309e5e9986c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:30.120228 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ee40379e-5afd-4a64-b9b7-1309e5e9986c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:30.275102 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-ee40379e-5afd-4a64-b9b7-1309e5e9986c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:30.288126 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ee40379e-5afd-4a64-b9b7-1309e5e9986c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1089 microversion: 2.1 time: 0.184860 Aug 26 16:01:30.304384 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 344/702] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:30 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1089 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:30.320341 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7f9a3820-d16e-49f0-be5f-40d69b46262a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '.version_select at 0x7f15d9496ca0>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:30.452837 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-7f9a3820-d16e-49f0-be5f-40d69b46262a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1810100575" status: 202 len: 0 microversion: 2.1 time: 0.147039 Aug 26 16:01:30.453863 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 345/703] 10.222.0.94 () {58 vars in 1221 bytes} [Fri Aug 26 16:01:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1810100575 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 16:01:30.490849 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-feff9518-f8e2-49b9-a844-8005c2f15e04 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:30.500680 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-feff9518-f8e2-49b9-a844-8005c2f15e04 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1735 microversion: 2.1 time: 0.459907 Aug 26 16:01:30.505528 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 359/704] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:30 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1735 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:31.047750 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f1b2156f-1029-439f-92e8-091844945961 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:31.048607 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-f1b2156f-1029-439f-92e8-091844945961 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:31.061226 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f1b2156f-1029-439f-92e8-091844945961 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:31.068675 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f1b2156f-1029-439f-92e8-091844945961 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:31.069459 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f1b2156f-1029-439f-92e8-091844945961 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:31.070600 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f1b2156f-1029-439f-92e8-091844945961 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:31.071459 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f1b2156f-1029-439f-92e8-091844945961 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:31.072432 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f1b2156f-1029-439f-92e8-091844945961 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:31.313734 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-eba852dc-619c-4c80-84c6-a406862657d3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:31.313734 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-eba852dc-619c-4c80-84c6-a406862657d3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:31.472919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-f1b2156f-1029-439f-92e8-091844945961 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:31.490296 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-f1b2156f-1029-439f-92e8-091844945961 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1664 microversion: 2.1 time: 0.448051 Aug 26 16:01:31.494167 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 346/705] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:31 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1664 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:31.533714 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-eba852dc-619c-4c80-84c6-a406862657d3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:31.536978 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-8bc180cd-6218-4505-8657-48add234fecb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:31.538018 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-8bc180cd-6218-4505-8657-48add234fecb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:31.543044 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-eba852dc-619c-4c80-84c6-a406862657d3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1089 microversion: 2.1 time: 0.236943 Aug 26 16:01:31.547139 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 360/706] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:31 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1089 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:31.553035 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8bc180cd-6218-4505-8657-48add234fecb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:31.553656 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8bc180cd-6218-4505-8657-48add234fecb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:31.556307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8bc180cd-6218-4505-8657-48add234fecb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:31.558801 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8bc180cd-6218-4505-8657-48add234fecb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:31.559366 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8bc180cd-6218-4505-8657-48add234fecb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:31.559810 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8bc180cd-6218-4505-8657-48add234fecb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:31.849027 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-8bc180cd-6218-4505-8657-48add234fecb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:31.850062 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-8bc180cd-6218-4505-8657-48add234fecb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1735 microversion: 2.1 time: 0.320084 Aug 26 16:01:31.860849 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 347/707] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:31 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1735 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:01:32.196731 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-6600626d-0be7-4f3e-baf5-29f742f39a29 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Action: 'create', calling method: .version_select at 0x7f15d95f6280>, body: {"keypair": {"name": "tempest-keypair-1320213866", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt9BwvyB7Mz4uHUXG4VAvvPhBYxvcvzGA+vmpIi62czLk8LG/GS+7X+mrpFvbGRVc71yOW0EUXlLRKdLs5OSgGqKCSbi+Qm7dZi5Xeh+zk6dhZ5kcoSVBcVJ4w7ex6IeQ=="}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:01:32.217928 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-6600626d-0be7-4f3e-baf5-29f742f39a29 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Getting quotas for project d95f731096d74a089f4161f5db69280c. Resources: {'key_pairs'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 16:01:32.222085 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-6600626d-0be7-4f3e-baf5-29f742f39a29 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Getting quotas for user b50041d36b0b430badd6442a2f09f063 and project d95f731096d74a089f4161f5db69280c. Resources: {'key_pairs'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 16:01:32.237606 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_api:SELECT=100 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:01:32.431721 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-6600626d-0be7-4f3e-baf5-29f742f39a29 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.240991 Aug 26 16:01:32.432326 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 361/708] 10.222.0.94 () {60 vars in 1159 bytes} [Fri Aug 26 16:01:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:01:32.515161 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-b3968397-e1a1-477c-ae19-7abef40bfd3f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:32.526220 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-b3968397-e1a1-477c-ae19-7abef40bfd3f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:32.526220 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b3968397-e1a1-477c-ae19-7abef40bfd3f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:32.526220 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b3968397-e1a1-477c-ae19-7abef40bfd3f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:32.526220 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b3968397-e1a1-477c-ae19-7abef40bfd3f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:32.526631 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b3968397-e1a1-477c-ae19-7abef40bfd3f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:32.526631 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b3968397-e1a1-477c-ae19-7abef40bfd3f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:32.526631 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b3968397-e1a1-477c-ae19-7abef40bfd3f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:32.529833 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:01:32.566582 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-f97267d3-c9f0-437f-95bc-6e5b0804bc2c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:32.567335 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-f97267d3-c9f0-437f-95bc-6e5b0804bc2c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:32.581364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f97267d3-c9f0-437f-95bc-6e5b0804bc2c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:32.581867 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f97267d3-c9f0-437f-95bc-6e5b0804bc2c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:32.582300 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f97267d3-c9f0-437f-95bc-6e5b0804bc2c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:32.585425 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f97267d3-c9f0-437f-95bc-6e5b0804bc2c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:32.585425 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f97267d3-c9f0-437f-95bc-6e5b0804bc2c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:32.585425 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f97267d3-c9f0-437f-95bc-6e5b0804bc2c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:32.676316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-f97267d3-c9f0-437f-95bc-6e5b0804bc2c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:32.686071 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-f97267d3-c9f0-437f-95bc-6e5b0804bc2c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1131 microversion: 2.1 time: 0.122628 Aug 26 16:01:32.687087 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 362/709] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:32 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1131 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:01:32.726277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-b3968397-e1a1-477c-ae19-7abef40bfd3f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:32.740252 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-b3968397-e1a1-477c-ae19-7abef40bfd3f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1668 microversion: 2.1 time: 0.228649 Aug 26 16:01:32.743964 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 348/710] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:32 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1668 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:32.873394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-e62cd3ef-bd38-46c9-903c-937d90ed0897 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:32.874427 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-e62cd3ef-bd38-46c9-903c-937d90ed0897 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:32.884462 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e62cd3ef-bd38-46c9-903c-937d90ed0897 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:32.889029 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e62cd3ef-bd38-46c9-903c-937d90ed0897 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:32.889029 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e62cd3ef-bd38-46c9-903c-937d90ed0897 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:32.889029 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e62cd3ef-bd38-46c9-903c-937d90ed0897 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:32.889029 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e62cd3ef-bd38-46c9-903c-937d90ed0897 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:32.889423 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e62cd3ef-bd38-46c9-903c-937d90ed0897 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:33.058733 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-e62cd3ef-bd38-46c9-903c-937d90ed0897 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:33.068787 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-e62cd3ef-bd38-46c9-903c-937d90ed0897 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1735 microversion: 2.1 time: 0.199787 Aug 26 16:01:33.069610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 363/711] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:32 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:33.709770 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-8bafdff3-075f-4233-b3ce-e58f78b50586 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:33.711409 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-8bafdff3-075f-4233-b3ce-e58f78b50586 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:33.730796 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8bafdff3-075f-4233-b3ce-e58f78b50586 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:33.731701 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8bafdff3-075f-4233-b3ce-e58f78b50586 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:33.734404 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8bafdff3-075f-4233-b3ce-e58f78b50586 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:33.737875 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8bafdff3-075f-4233-b3ce-e58f78b50586 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:33.738533 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8bafdff3-075f-4233-b3ce-e58f78b50586 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:33.740374 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8bafdff3-075f-4233-b3ce-e58f78b50586 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:33.819816 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-8bafdff3-075f-4233-b3ce-e58f78b50586 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:33.829237 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-8bafdff3-075f-4233-b3ce-e58f78b50586 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1131 microversion: 2.1 time: 0.124952 Aug 26 16:01:33.830376 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 349/712] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:33 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1131 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:01:34.093735 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-224da72b-1374-4c1c-b02c-165026a0050a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:34.094367 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-224da72b-1374-4c1c-b02c-165026a0050a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:34.101057 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-224da72b-1374-4c1c-b02c-165026a0050a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:34.101772 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-224da72b-1374-4c1c-b02c-165026a0050a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:34.102447 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-224da72b-1374-4c1c-b02c-165026a0050a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:34.103298 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-224da72b-1374-4c1c-b02c-165026a0050a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:34.103950 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-224da72b-1374-4c1c-b02c-165026a0050a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:34.104573 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-224da72b-1374-4c1c-b02c-165026a0050a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:34.376769 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-224da72b-1374-4c1c-b02c-165026a0050a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:34.385887 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-224da72b-1374-4c1c-b02c-165026a0050a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1735 microversion: 2.1 time: 0.299031 Aug 26 16:01:34.386758 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 364/713] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:34 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1735 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:34.851661 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-70a979f3-0a2e-4b70-af67-f2d23e393f15 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:34.852304 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-70a979f3-0a2e-4b70-af67-f2d23e393f15 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:34.863755 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-70a979f3-0a2e-4b70-af67-f2d23e393f15 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:34.868790 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-70a979f3-0a2e-4b70-af67-f2d23e393f15 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:34.869492 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-70a979f3-0a2e-4b70-af67-f2d23e393f15 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:34.870229 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-70a979f3-0a2e-4b70-af67-f2d23e393f15 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:34.870686 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-70a979f3-0a2e-4b70-af67-f2d23e393f15 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:34.874420 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-70a979f3-0a2e-4b70-af67-f2d23e393f15 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:34.967814 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-70a979f3-0a2e-4b70-af67-f2d23e393f15 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:34.987873 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-70a979f3-0a2e-4b70-af67-f2d23e393f15 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1131 microversion: 2.1 time: 0.140413 Aug 26 16:01:35.001306 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 350/714] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:34 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1131 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:35.411434 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-659eb5ec-a726-47dc-af05-beb863ba4bb9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:35.415534 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-659eb5ec-a726-47dc-af05-beb863ba4bb9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:35.436057 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-659eb5ec-a726-47dc-af05-beb863ba4bb9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:35.436861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-659eb5ec-a726-47dc-af05-beb863ba4bb9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:35.437186 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-659eb5ec-a726-47dc-af05-beb863ba4bb9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:35.437975 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-659eb5ec-a726-47dc-af05-beb863ba4bb9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:35.445549 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-659eb5ec-a726-47dc-af05-beb863ba4bb9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:35.449840 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-659eb5ec-a726-47dc-af05-beb863ba4bb9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:35.774083 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-659eb5ec-a726-47dc-af05-beb863ba4bb9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:35.803705 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-659eb5ec-a726-47dc-af05-beb863ba4bb9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1735 microversion: 2.1 time: 0.397528 Aug 26 16:01:35.805232 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 365/715] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:35 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1735 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:35.922851 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-77d67a12-294d-4d68-9ddc-1af523491886 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-565317962", "imageRef": "bcbdbb0c-7335-4427-a636-e2dc730274b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62414327-5b31-4d4a-b372-9a9bbc06aa9d"}], "security_groups": [{"name": "tempest-securitygroup--598176739"}], "key_name": "tempest-keypair-1320213866", "user_data": "}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:01:36.017779 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-0d795c6f-aab5-4f70-9d09-84f6a72d785f tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:36.018588 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-0d795c6f-aab5-4f70-9d09-84f6a72d785f tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:36.042413 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0d795c6f-aab5-4f70-9d09-84f6a72d785f tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:36.043341 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0d795c6f-aab5-4f70-9d09-84f6a72d785f tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:36.046193 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0d795c6f-aab5-4f70-9d09-84f6a72d785f tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:36.046193 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0d795c6f-aab5-4f70-9d09-84f6a72d785f tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:36.046193 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0d795c6f-aab5-4f70-9d09-84f6a72d785f tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:36.047905 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0d795c6f-aab5-4f70-9d09-84f6a72d785f tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:36.220748 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-0d795c6f-aab5-4f70-9d09-84f6a72d785f tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:36.229539 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-0d795c6f-aab5-4f70-9d09-84f6a72d785f tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1187 microversion: 2.1 time: 0.224180 Aug 26 16:01:36.230710 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 366/716] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:36 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1187 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:36.299064 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.network.neutron [None req-77d67a12-294d-4d68-9ddc-1af523491886 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] validate_networks() for [('62414327-5b31-4d4a-b372-9a9bbc06aa9d', None, None, None, None, None)] {{(pid=128304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 16:01:36.850965 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-7e16cc11-cc3a-4de5-ac65-96a968ddc8a1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:36.850965 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-7e16cc11-cc3a-4de5-ac65-96a968ddc8a1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:36.850965 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7e16cc11-cc3a-4de5-ac65-96a968ddc8a1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:36.850965 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7e16cc11-cc3a-4de5-ac65-96a968ddc8a1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:36.852081 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7e16cc11-cc3a-4de5-ac65-96a968ddc8a1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:36.852437 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7e16cc11-cc3a-4de5-ac65-96a968ddc8a1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:36.852655 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7e16cc11-cc3a-4de5-ac65-96a968ddc8a1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:36.853115 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7e16cc11-cc3a-4de5-ac65-96a968ddc8a1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:36.854729 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-77d67a12-294d-4d68-9ddc-1af523491886 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Flavor limits 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 16:01:36.856520 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-77d67a12-294d-4d68-9ddc-1af523491886 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Image limits 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 16:01:36.857752 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-77d67a12-294d-4d68-9ddc-1af523491886 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Flavor pref 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 16:01:36.858196 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-77d67a12-294d-4d68-9ddc-1af523491886 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Image pref 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 16:01:36.858616 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-77d67a12-294d-4d68-9ddc-1af523491886 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 16:01:36.869683 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-77d67a12-294d-4d68-9ddc-1af523491886 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:36.870236 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-77d67a12-294d-4d68-9ddc-1af523491886 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:36.870670 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-77d67a12-294d-4d68-9ddc-1af523491886 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:36.871477 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-77d67a12-294d-4d68-9ddc-1af523491886 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:36.872106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-77d67a12-294d-4d68-9ddc-1af523491886 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:36.873445 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-77d67a12-294d-4d68-9ddc-1af523491886 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:36.892048 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-77d67a12-294d-4d68-9ddc-1af523491886 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Getting quotas for project d95f731096d74a089f4161f5db69280c. Resources: {'instances', 'ram', 'cores'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 16:01:36.896355 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-77d67a12-294d-4d68-9ddc-1af523491886 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Getting quotas for user b50041d36b0b430badd6442a2f09f063 and project d95f731096d74a089f4161f5db69280c. Resources: {'instances', 'ram', 'cores'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 16:01:36.908713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-77d67a12-294d-4d68-9ddc-1af523491886 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Going to run 1 instances... {{(pid=128304) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 16:01:36.911064 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-77d67a12-294d-4d68-9ddc-1af523491886 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bcbdbb0c-7335-4427-a636-e2dc730274b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 16:01:37.010783 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-7e16cc11-cc3a-4de5-ac65-96a968ddc8a1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:37.022771 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-7e16cc11-cc3a-4de5-ac65-96a968ddc8a1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1735 microversion: 2.1 time: 0.199603 Aug 26 16:01:37.023381 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 367/717] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:36 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:01:37.167266 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-77d67a12-294d-4d68-9ddc-1af523491886 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.249377 Aug 26 16:01:37.187140 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 351/718] 10.222.0.94 () {60 vars in 1147 bytes} [Fri Aug 26 16:01:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 1251 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 16:01:37.187296 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-f5000332-a734-45a0-a312-dc2ea99ea386 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:37.187296 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-f5000332-a734-45a0-a312-dc2ea99ea386 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:37.236895 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-f5000332-a734-45a0-a312-dc2ea99ea386 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:37.243874 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-f5000332-a734-45a0-a312-dc2ea99ea386 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1241 microversion: 2.1 time: 0.068323 Aug 26 16:01:37.278588 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 368/719] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:37 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:37.280292 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-1fcf8251-13ed-4f9f-8cd6-aca59150eb42 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:37.280292 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-1fcf8251-13ed-4f9f-8cd6-aca59150eb42 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:37.280292 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1fcf8251-13ed-4f9f-8cd6-aca59150eb42 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:37.280292 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1fcf8251-13ed-4f9f-8cd6-aca59150eb42 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:37.280713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1fcf8251-13ed-4f9f-8cd6-aca59150eb42 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:37.280713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1fcf8251-13ed-4f9f-8cd6-aca59150eb42 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:37.280713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1fcf8251-13ed-4f9f-8cd6-aca59150eb42 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:37.280713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1fcf8251-13ed-4f9f-8cd6-aca59150eb42 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:37.334207 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-1fcf8251-13ed-4f9f-8cd6-aca59150eb42 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:37.346803 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-1fcf8251-13ed-4f9f-8cd6-aca59150eb42 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1187 microversion: 2.1 time: 0.100719 Aug 26 16:01:37.348277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 352/720] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:37 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1187 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:38.046973 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-5dc51d77-3067-4e97-90d0-5f7516fd10a4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:38.048332 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-5dc51d77-3067-4e97-90d0-5f7516fd10a4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:38.061212 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5dc51d77-3067-4e97-90d0-5f7516fd10a4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:38.061808 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5dc51d77-3067-4e97-90d0-5f7516fd10a4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:38.064954 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5dc51d77-3067-4e97-90d0-5f7516fd10a4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:38.064954 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5dc51d77-3067-4e97-90d0-5f7516fd10a4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:38.064954 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5dc51d77-3067-4e97-90d0-5f7516fd10a4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:38.064954 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5dc51d77-3067-4e97-90d0-5f7516fd10a4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:38.177989 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-68f45596-8fb0-4e4f-b40a-f8413ce11cb8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:38.179183 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-68f45596-8fb0-4e4f-b40a-f8413ce11cb8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:38.205680 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-68f45596-8fb0-4e4f-b40a-f8413ce11cb8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:38.208527 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-68f45596-8fb0-4e4f-b40a-f8413ce11cb8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:38.210787 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-68f45596-8fb0-4e4f-b40a-f8413ce11cb8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:38.211804 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-68f45596-8fb0-4e4f-b40a-f8413ce11cb8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:38.215059 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-68f45596-8fb0-4e4f-b40a-f8413ce11cb8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:38.215687 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-68f45596-8fb0-4e4f-b40a-f8413ce11cb8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:38.259971 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-68f45596-8fb0-4e4f-b40a-f8413ce11cb8 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1/os-volume_attachments/468b26a0-7c98-4ab9-bcc7-0a0726896ec1" status: 200 len: 194 microversion: 2.20 time: 0.086326 Aug 26 16:01:38.272277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 353/721] 10.222.0.94 () {60 vars in 1454 bytes} [Fri Aug 26 16:01:38 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1/os-volume_attachments/468b26a0-7c98-4ab9-bcc7-0a0726896ec1 => generated 194 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 16:01:38.287014 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ed8470be-54cd-4c3e-a8c9-9c20432753cd tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:38.289855 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ed8470be-54cd-4c3e-a8c9-9c20432753cd tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:38.298661 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ed8470be-54cd-4c3e-a8c9-9c20432753cd tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:38.299825 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ed8470be-54cd-4c3e-a8c9-9c20432753cd tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:38.306904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ed8470be-54cd-4c3e-a8c9-9c20432753cd tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:38.306904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ed8470be-54cd-4c3e-a8c9-9c20432753cd tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:38.306904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ed8470be-54cd-4c3e-a8c9-9c20432753cd tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:38.306904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ed8470be-54cd-4c3e-a8c9-9c20432753cd tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:38.408587 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-ed8470be-54cd-4c3e-a8c9-9c20432753cd tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:38.430039 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ed8470be-54cd-4c3e-a8c9-9c20432753cd tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1245 microversion: 2.1 time: 0.146789 Aug 26 16:01:38.431401 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 354/722] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:38 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1245 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:38.438102 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-45eb6f93-dbd4-470e-9529-d8b95f03d92f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:38.439205 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-45eb6f93-dbd4-470e-9529-d8b95f03d92f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:38.447930 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-45eb6f93-dbd4-470e-9529-d8b95f03d92f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:38.448718 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-45eb6f93-dbd4-470e-9529-d8b95f03d92f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:38.449587 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-45eb6f93-dbd4-470e-9529-d8b95f03d92f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:38.453042 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-45eb6f93-dbd4-470e-9529-d8b95f03d92f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:38.453828 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-45eb6f93-dbd4-470e-9529-d8b95f03d92f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:38.456037 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-45eb6f93-dbd4-470e-9529-d8b95f03d92f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:38.478669 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-5dc51d77-3067-4e97-90d0-5f7516fd10a4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:38.489857 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-5dc51d77-3067-4e97-90d0-5f7516fd10a4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1735 microversion: 2.1 time: 0.447645 Aug 26 16:01:38.490870 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 369/723] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:38 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1735 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:38.496318 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-045c9364-ae66-4913-8650-63263cba625a tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:38.498096 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-045c9364-ae66-4913-8650-63263cba625a tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:38.505123 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-045c9364-ae66-4913-8650-63263cba625a tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:38.505711 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-045c9364-ae66-4913-8650-63263cba625a tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:38.506207 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-045c9364-ae66-4913-8650-63263cba625a tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:38.507036 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-045c9364-ae66-4913-8650-63263cba625a tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:38.507624 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-045c9364-ae66-4913-8650-63263cba625a tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:38.508291 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-045c9364-ae66-4913-8650-63263cba625a tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:38.584532 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.objects.instance [None req-45eb6f93-dbd4-470e-9529-d8b95f03d92f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lazy-loading 'services' on Instance uuid 8ac977a7-aa08-459a-a863-36ba667422d1 {{(pid=128304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:01:38.601297 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-045c9364-ae66-4913-8650-63263cba625a tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:38.609408 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-045c9364-ae66-4913-8650-63263cba625a tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1205 microversion: 2.1 time: 0.117225 Aug 26 16:01:38.616665 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 370/724] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:38 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1205 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:38.845778 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-45eb6f93-dbd4-470e-9529-d8b95f03d92f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "DELETE /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1/os-volume_attachments/468b26a0-7c98-4ab9-bcc7-0a0726896ec1" status: 202 len: 0 microversion: 2.20 time: 0.412290 Aug 26 16:01:38.846733 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 355/725] 10.222.0.94 () {60 vars in 1457 bytes} [Fri Aug 26 16:01:38 2022] DELETE /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1/os-volume_attachments/468b26a0-7c98-4ab9-bcc7-0a0726896ec1 => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 16:01:38.855149 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-4b40eb1a-5e56-4eee-8b86-c5af0e7b293f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:38.857413 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-4b40eb1a-5e56-4eee-8b86-c5af0e7b293f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:38.867417 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4b40eb1a-5e56-4eee-8b86-c5af0e7b293f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:38.868154 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4b40eb1a-5e56-4eee-8b86-c5af0e7b293f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:38.868822 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4b40eb1a-5e56-4eee-8b86-c5af0e7b293f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:38.880802 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4b40eb1a-5e56-4eee-8b86-c5af0e7b293f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:38.880802 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4b40eb1a-5e56-4eee-8b86-c5af0e7b293f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:38.880802 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4b40eb1a-5e56-4eee-8b86-c5af0e7b293f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:38.956788 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:01:38.960495 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-4b40eb1a-5e56-4eee-8b86-c5af0e7b293f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.109389 Aug 26 16:01:38.961590 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 371/726] 10.222.0.94 () {60 vars in 1343 bytes} [Fri Aug 26 16:01:38 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 16:01:39.454103 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-52f9ab06-92bb-4760-80d3-bb8e398bbe27 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:39.454813 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-52f9ab06-92bb-4760-80d3-bb8e398bbe27 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:39.475018 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-52f9ab06-92bb-4760-80d3-bb8e398bbe27 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:39.475518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-52f9ab06-92bb-4760-80d3-bb8e398bbe27 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:39.475959 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-52f9ab06-92bb-4760-80d3-bb8e398bbe27 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:39.476672 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-52f9ab06-92bb-4760-80d3-bb8e398bbe27 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:39.477131 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-52f9ab06-92bb-4760-80d3-bb8e398bbe27 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:39.477555 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-52f9ab06-92bb-4760-80d3-bb8e398bbe27 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:39.518354 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-50c7a6f9-4aad-4297-be40-2989f1e9f438 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:39.519056 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-50c7a6f9-4aad-4297-be40-2989f1e9f438 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:39.527081 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-50c7a6f9-4aad-4297-be40-2989f1e9f438 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:39.527954 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-50c7a6f9-4aad-4297-be40-2989f1e9f438 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:39.528619 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-50c7a6f9-4aad-4297-be40-2989f1e9f438 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:39.530015 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-50c7a6f9-4aad-4297-be40-2989f1e9f438 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:39.531035 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-50c7a6f9-4aad-4297-be40-2989f1e9f438 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:39.531740 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-50c7a6f9-4aad-4297-be40-2989f1e9f438 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:39.611710 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-52f9ab06-92bb-4760-80d3-bb8e398bbe27 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:39.624589 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-52f9ab06-92bb-4760-80d3-bb8e398bbe27 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1237 microversion: 2.1 time: 0.175599 Aug 26 16:01:39.625714 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 356/727] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:39 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1237 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:39.646418 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-22e76d96-dca7-4f36-a40d-13c5fb2b7e02 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:39.647477 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-22e76d96-dca7-4f36-a40d-13c5fb2b7e02 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:39.661610 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-22e76d96-dca7-4f36-a40d-13c5fb2b7e02 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:39.662813 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-22e76d96-dca7-4f36-a40d-13c5fb2b7e02 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:39.663419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-22e76d96-dca7-4f36-a40d-13c5fb2b7e02 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:39.664244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-22e76d96-dca7-4f36-a40d-13c5fb2b7e02 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:39.664937 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-22e76d96-dca7-4f36-a40d-13c5fb2b7e02 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:39.665707 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-22e76d96-dca7-4f36-a40d-13c5fb2b7e02 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:39.951854 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-50c7a6f9-4aad-4297-be40-2989f1e9f438 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:39.965793 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-50c7a6f9-4aad-4297-be40-2989f1e9f438 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1715 microversion: 2.1 time: 0.456333 Aug 26 16:01:39.969035 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 372/728] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:39 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1715 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:39.984173 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-0eedbc54-8972-4af4-bcb0-374f25bd7a63 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:39.986560 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-0eedbc54-8972-4af4-bcb0-374f25bd7a63 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:39.989637 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-22e76d96-dca7-4f36-a40d-13c5fb2b7e02 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:39.995194 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0eedbc54-8972-4af4-bcb0-374f25bd7a63 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:39.995923 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0eedbc54-8972-4af4-bcb0-374f25bd7a63 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:39.996746 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0eedbc54-8972-4af4-bcb0-374f25bd7a63 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:40.007340 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0eedbc54-8972-4af4-bcb0-374f25bd7a63 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:40.007340 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0eedbc54-8972-4af4-bcb0-374f25bd7a63 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:40.007340 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0eedbc54-8972-4af4-bcb0-374f25bd7a63 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:40.008256 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-22e76d96-dca7-4f36-a40d-13c5fb2b7e02 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1272 microversion: 2.1 time: 0.371639 Aug 26 16:01:40.008256 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 357/729] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:39 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1272 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:40.069494 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-0eedbc54-8972-4af4-bcb0-374f25bd7a63 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.099167 Aug 26 16:01:40.070522 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 373/730] 10.222.0.94 () {60 vars in 1343 bytes} [Fri Aug 26 16:01:39 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 16:01:40.127792 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-8ca4f826-60e3-424e-a9d0-b3fba906e6d0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:40.128556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-8ca4f826-60e3-424e-a9d0-b3fba906e6d0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:40.145976 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8ca4f826-60e3-424e-a9d0-b3fba906e6d0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:40.146507 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8ca4f826-60e3-424e-a9d0-b3fba906e6d0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:40.156265 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8ca4f826-60e3-424e-a9d0-b3fba906e6d0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:40.160214 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8ca4f826-60e3-424e-a9d0-b3fba906e6d0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:40.164492 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8ca4f826-60e3-424e-a9d0-b3fba906e6d0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:40.165998 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8ca4f826-60e3-424e-a9d0-b3fba906e6d0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:40.318276 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-8ca4f826-60e3-424e-a9d0-b3fba906e6d0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] HTTP exception thrown: Cannot 'detach_volume' instance 842d5015-aa0d-46a5-8162-7201b4277653 while it is in vm_state rescued Aug 26 16:01:40.320312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-8ca4f826-60e3-424e-a9d0-b3fba906e6d0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Request method failure captured: Aug 26 16:01:40.320312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: DELETE /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653/os-volume_attachments/7c088d23-850b-48a9-94dc-d0ef2c0108f5 HTTP/1.1 Aug 26 16:01:40.320312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 16:01:40.320312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 16:01:40.320312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 16:01:40.320312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 0 Aug 26 16:01:40.320312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 16:01:40.320312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 16:01:40.320312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 16:01:40.320312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 16:01:40.320312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO0_sl285hvUjJgmI9tiwf2bPWJ_USKAuZl9qlXiPcbxQIVW1O_h2ghJjLWiyYPk1X7WhbLdFcB00PMIvtPLvDgRyMUSdg3tkWBfuoTGjVfkvNMUX-nJPvr_-GzeeJRuzdQ89_WhGnhJFkicXMewwKHJxRcDkRVBAc7d0S88NP2f2_c Aug 26 16:01:40.320312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 16:01:40.320312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 16:01:40.320312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 16:01:40.320312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 16:01:40.320312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 16:01:40.320312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 16:01:40.320312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: 5f170813ecff47a68d7610de9d769287 Aug 26 16:01:40.320312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1667711701 Aug 26 16:01:40.320312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 16:01:40.320312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 16:01:40.321889 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/5f170813ecff47a68d7610de9d769287"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/5f170813ecff47a68d7610de9d769287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/5f170813ecff47a68d7610de9d769287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_5f170813ecff47a68d7610de9d769287", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:01:40.321889 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1667711701 Aug 26 16:01:40.321889 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: 5f170813ecff47a68d7610de9d769287 Aug 26 16:01:40.321889 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1667711701 Aug 26 16:01:40.321889 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-ServerRescueNegativeTestJSON-1667711701-project Aug 26 16:01:40.321889 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 16:01:40.321889 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 16:01:40.321889 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: 4940f8a9c15a483eab251df392789534 Aug 26 16:01:40.321889 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1667711701-project Aug 26 16:01:40.321889 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: > Aug 26 16:01:40.321889 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Cannot 'detach_volume' instance 842d5015-aa0d-46a5-8162-7201b4277653 while it is in vm_state rescued Aug 26 16:01:40.322529 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'server_id': '842d5015-aa0d-46a5-8162-7201b4277653', 'id': '7c088d23-850b-48a9-94dc-d0ef2c0108f5'} Aug 26 16:01:40.322529 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:01:40.322529 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:40.322529 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 26 16:01:40.322529 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 26 16:01:40.322529 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 16:01:40.322529 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 16:01:40.322529 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 26 16:01:40.322529 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 26 16:01:40.322529 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 842d5015-aa0d-46a5-8162-7201b4277653 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 26 16:01:40.322529 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:01:40.322529 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:01:40.322529 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:01:40.322529 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:40.322529 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:01:40.322529 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:01:40.322529 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:01:40.322529 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:01:40.322529 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:01:40.322529 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:01:40.323688 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 26 16:01:40.323688 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 26 16:01:40.323688 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 26 16:01:40.323688 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 26 16:01:40.323688 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 842d5015-aa0d-46a5-8162-7201b4277653 while it is in vm_state rescued Aug 26 16:01:40.323688 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:01:40.323688 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:01:40.323688 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:01:40.323688 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:40.323688 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:01:40.323688 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:01:40.323688 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:01:40.323688 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:01:40.323688 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 842d5015-aa0d-46a5-8162-7201b4277653 while it is in vm_state rescued Aug 26 16:01:40.323688 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:01:40.326788 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-8ca4f826-60e3-424e-a9d0-b3fba906e6d0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Returning 409 to user: Cannot 'detach_volume' instance 842d5015-aa0d-46a5-8162-7201b4277653 while it is in vm_state rescued {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:01:40.327875 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-8ca4f826-60e3-424e-a9d0-b3fba906e6d0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "DELETE /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653/os-volume_attachments/7c088d23-850b-48a9-94dc-d0ef2c0108f5" status: 409 len: 152 microversion: 2.1 time: 0.205168 Aug 26 16:01:40.329100 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 358/731] 10.222.0.94 () {58 vars in 1416 bytes} [Fri Aug 26 16:01:40 2022] DELETE /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653/os-volume_attachments/7c088d23-850b-48a9-94dc-d0ef2c0108f5 => generated 152 bytes in 207 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 26 16:01:40.337788 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-653a7d09-bda8-46d6-8187-893a879c82e6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:01:40.338817 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-653a7d09-bda8-46d6-8187-893a879c82e6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:40.345797 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-653a7d09-bda8-46d6-8187-893a879c82e6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:40.349880 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-653a7d09-bda8-46d6-8187-893a879c82e6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:40.352325 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-653a7d09-bda8-46d6-8187-893a879c82e6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:40.355447 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-653a7d09-bda8-46d6-8187-893a879c82e6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:40.358791 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-653a7d09-bda8-46d6-8187-893a879c82e6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:40.360726 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-653a7d09-bda8-46d6-8187-893a879c82e6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:40.649716 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f91cde90-105e-427e-9ac9-9e17cd1dc3b2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:40.651076 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-f91cde90-105e-427e-9ac9-9e17cd1dc3b2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:40.661247 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f91cde90-105e-427e-9ac9-9e17cd1dc3b2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:40.666729 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f91cde90-105e-427e-9ac9-9e17cd1dc3b2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:40.667297 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f91cde90-105e-427e-9ac9-9e17cd1dc3b2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:40.668113 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f91cde90-105e-427e-9ac9-9e17cd1dc3b2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:40.668654 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f91cde90-105e-427e-9ac9-9e17cd1dc3b2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:40.669156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f91cde90-105e-427e-9ac9-9e17cd1dc3b2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:40.680227 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-653a7d09-bda8-46d6-8187-893a879c82e6 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "POST /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653/action" status: 202 len: 0 microversion: 2.1 time: 0.346207 Aug 26 16:01:40.681252 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 374/732] 10.222.0.94 () {60 vars in 1278 bytes} [Fri Aug 26 16:01:40 2022] POST /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 16:01:40.693852 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-d0d7d7b9-52fb-4fb2-a4e9-4b1e547c15de tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:40.698269 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-d0d7d7b9-52fb-4fb2-a4e9-4b1e547c15de tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:40.728227 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d0d7d7b9-52fb-4fb2-a4e9-4b1e547c15de tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:40.731528 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d0d7d7b9-52fb-4fb2-a4e9-4b1e547c15de tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:40.737295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d0d7d7b9-52fb-4fb2-a4e9-4b1e547c15de tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:40.741729 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d0d7d7b9-52fb-4fb2-a4e9-4b1e547c15de tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:40.742630 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d0d7d7b9-52fb-4fb2-a4e9-4b1e547c15de tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:40.743805 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d0d7d7b9-52fb-4fb2-a4e9-4b1e547c15de tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:40.816084 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-f91cde90-105e-427e-9ac9-9e17cd1dc3b2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:40.835533 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-f91cde90-105e-427e-9ac9-9e17cd1dc3b2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1301 microversion: 2.1 time: 0.185837 Aug 26 16:01:40.836813 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 359/733] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:40 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1301 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:41.035756 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-38460aae-f31d-494f-9393-4cef1ded789d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:41.036769 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-38460aae-f31d-494f-9393-4cef1ded789d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:41.047594 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-38460aae-f31d-494f-9393-4cef1ded789d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:41.051347 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-38460aae-f31d-494f-9393-4cef1ded789d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:41.051347 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-38460aae-f31d-494f-9393-4cef1ded789d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:41.051347 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-38460aae-f31d-494f-9393-4cef1ded789d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:41.051347 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-38460aae-f31d-494f-9393-4cef1ded789d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:41.068838 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-38460aae-f31d-494f-9393-4cef1ded789d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:41.083363 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d0d7d7b9-52fb-4fb2-a4e9-4b1e547c15de tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:41.105962 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-d0d7d7b9-52fb-4fb2-a4e9-4b1e547c15de tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1723 microversion: 2.1 time: 0.419274 Aug 26 16:01:41.122280 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 375/734] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:40 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1723 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:41.127923 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-332bd865-cfc4-4de5-9834-9e4955882630 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:41.130546 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-332bd865-cfc4-4de5-9834-9e4955882630 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:41.139731 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-332bd865-cfc4-4de5-9834-9e4955882630 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:41.140223 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-332bd865-cfc4-4de5-9834-9e4955882630 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:41.140661 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-332bd865-cfc4-4de5-9834-9e4955882630 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:41.143642 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-332bd865-cfc4-4de5-9834-9e4955882630 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:41.144727 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-332bd865-cfc4-4de5-9834-9e4955882630 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:41.145192 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-332bd865-cfc4-4de5-9834-9e4955882630 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:41.220967 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-332bd865-cfc4-4de5-9834-9e4955882630 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.098316 Aug 26 16:01:41.228096 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 376/735] 10.222.0.94 () {60 vars in 1343 bytes} [Fri Aug 26 16:01:41 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 16:01:41.381369 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-4242e477-115b-441a-a251-abf8692d7e9e req-e93081db-c392-479d-8af0-f6483d5a1814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b456054b-9e50-43c0-ae5a-8f614cbc102b", "tag": "7450399c-70d1-4b9d-9b20-fdef692f4a6d"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:01:41.410185 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-4242e477-115b-441a-a251-abf8692d7e9e req-e93081db-c392-479d-8af0-f6483d5a1814 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:41.410662 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-4242e477-115b-441a-a251-abf8692d7e9e req-e93081db-c392-479d-8af0-f6483d5a1814 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:41.411594 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-4242e477-115b-441a-a251-abf8692d7e9e req-e93081db-c392-479d-8af0-f6483d5a1814 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:41.422538 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-4242e477-115b-441a-a251-abf8692d7e9e req-e93081db-c392-479d-8af0-f6483d5a1814 service nova] Creating event network-changed:7450399c-70d1-4b9d-9b20-fdef692f4a6d for instance b456054b-9e50-43c0-ae5a-8f614cbc102b on hv-cinder-85144 Aug 26 16:01:41.432048 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-4242e477-115b-441a-a251-abf8692d7e9e req-e93081db-c392-479d-8af0-f6483d5a1814 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055004 Aug 26 16:01:41.432652 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 377/736] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:01:41.672989 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-38460aae-f31d-494f-9393-4cef1ded789d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:41.681574 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-38460aae-f31d-494f-9393-4cef1ded789d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1272 microversion: 2.1 time: 0.652893 Aug 26 16:01:41.682159 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 360/737] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:41 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1272 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:41.863029 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-d6ca5947-28d3-4d78-b8c1-702a918bf3f5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:41.864305 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-d6ca5947-28d3-4d78-b8c1-702a918bf3f5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:41.870500 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d6ca5947-28d3-4d78-b8c1-702a918bf3f5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:41.871404 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d6ca5947-28d3-4d78-b8c1-702a918bf3f5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:41.872039 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d6ca5947-28d3-4d78-b8c1-702a918bf3f5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:41.872770 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d6ca5947-28d3-4d78-b8c1-702a918bf3f5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:41.873209 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d6ca5947-28d3-4d78-b8c1-702a918bf3f5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:41.873787 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d6ca5947-28d3-4d78-b8c1-702a918bf3f5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:42.021710 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d6ca5947-28d3-4d78-b8c1-702a918bf3f5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:42.034212 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-d6ca5947-28d3-4d78-b8c1-702a918bf3f5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1311 microversion: 2.1 time: 0.177961 Aug 26 16:01:42.035051 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 378/738] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:41 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1311 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:42.131554 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-6977effa-202c-4da7-baf4-9310474d4813 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:42.132221 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-6977effa-202c-4da7-baf4-9310474d4813 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:42.148726 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6977effa-202c-4da7-baf4-9310474d4813 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:42.149544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6977effa-202c-4da7-baf4-9310474d4813 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:42.155771 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6977effa-202c-4da7-baf4-9310474d4813 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:42.156640 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6977effa-202c-4da7-baf4-9310474d4813 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:42.157327 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6977effa-202c-4da7-baf4-9310474d4813 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:42.157941 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6977effa-202c-4da7-baf4-9310474d4813 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:42.234599 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-0dd65a62-df12-4725-a5a2-2fd140acc881 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:42.239330 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-0dd65a62-df12-4725-a5a2-2fd140acc881 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:42.245754 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0dd65a62-df12-4725-a5a2-2fd140acc881 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:42.246390 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0dd65a62-df12-4725-a5a2-2fd140acc881 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:42.251418 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0dd65a62-df12-4725-a5a2-2fd140acc881 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:42.251418 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0dd65a62-df12-4725-a5a2-2fd140acc881 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:42.251418 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0dd65a62-df12-4725-a5a2-2fd140acc881 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:42.251418 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0dd65a62-df12-4725-a5a2-2fd140acc881 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:42.283162 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-0dd65a62-df12-4725-a5a2-2fd140acc881 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053169 Aug 26 16:01:42.284038 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 379/739] 10.222.0.94 () {60 vars in 1343 bytes} [Fri Aug 26 16:01:42 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 16:01:42.566894 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-6977effa-202c-4da7-baf4-9310474d4813 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:42.582562 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-6977effa-202c-4da7-baf4-9310474d4813 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1723 microversion: 2.1 time: 0.454724 Aug 26 16:01:42.596723 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 361/740] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:42 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1723 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:42.704356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a4cca6c7-83cc-4ce7-bbe5-d4ac73b9c02c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:42.705183 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a4cca6c7-83cc-4ce7-bbe5-d4ac73b9c02c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:42.717837 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a4cca6c7-83cc-4ce7-bbe5-d4ac73b9c02c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:42.717837 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a4cca6c7-83cc-4ce7-bbe5-d4ac73b9c02c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:42.717837 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a4cca6c7-83cc-4ce7-bbe5-d4ac73b9c02c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:42.725315 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a4cca6c7-83cc-4ce7-bbe5-d4ac73b9c02c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:42.725689 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a4cca6c7-83cc-4ce7-bbe5-d4ac73b9c02c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:42.727540 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a4cca6c7-83cc-4ce7-bbe5-d4ac73b9c02c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:43.056650 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7772b6f5-d359-415d-8d81-c22d9a3a5f84 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:43.057260 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-7772b6f5-d359-415d-8d81-c22d9a3a5f84 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:43.067953 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a4cca6c7-83cc-4ce7-bbe5-d4ac73b9c02c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:43.079740 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7772b6f5-d359-415d-8d81-c22d9a3a5f84 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:43.088287 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a4cca6c7-83cc-4ce7-bbe5-d4ac73b9c02c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1260 microversion: 2.1 time: 0.385435 Aug 26 16:01:43.088900 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 380/741] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:42 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1260 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:43.092510 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7772b6f5-d359-415d-8d81-c22d9a3a5f84 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:43.093079 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7772b6f5-d359-415d-8d81-c22d9a3a5f84 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:43.094270 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7772b6f5-d359-415d-8d81-c22d9a3a5f84 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:43.094961 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7772b6f5-d359-415d-8d81-c22d9a3a5f84 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:43.095539 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7772b6f5-d359-415d-8d81-c22d9a3a5f84 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:43.314268 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-4ae4e284-2c76-407b-8741-f783e29cea13 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:43.316571 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-4ae4e284-2c76-407b-8741-f783e29cea13 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:43.346032 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4ae4e284-2c76-407b-8741-f783e29cea13 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:43.346518 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4ae4e284-2c76-407b-8741-f783e29cea13 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:43.346969 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4ae4e284-2c76-407b-8741-f783e29cea13 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:43.347708 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4ae4e284-2c76-407b-8741-f783e29cea13 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:43.353617 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4ae4e284-2c76-407b-8741-f783e29cea13 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:43.363380 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4ae4e284-2c76-407b-8741-f783e29cea13 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:43.458546 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-4ae4e284-2c76-407b-8741-f783e29cea13 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.166705 Aug 26 16:01:43.477066 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 381/742] 10.222.0.94 () {60 vars in 1343 bytes} [Fri Aug 26 16:01:43 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1/os-volume_attachments => generated 25 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:43.528040 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7772b6f5-d359-415d-8d81-c22d9a3a5f84 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:43.543708 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-1623d86d-ed16-41d2-a580-7e731e1ac17e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:43.544734 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-1623d86d-ed16-41d2-a580-7e731e1ac17e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:43.551247 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1623d86d-ed16-41d2-a580-7e731e1ac17e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:43.551739 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1623d86d-ed16-41d2-a580-7e731e1ac17e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:43.552178 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1623d86d-ed16-41d2-a580-7e731e1ac17e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:43.552882 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1623d86d-ed16-41d2-a580-7e731e1ac17e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:43.553334 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1623d86d-ed16-41d2-a580-7e731e1ac17e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:43.553760 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1623d86d-ed16-41d2-a580-7e731e1ac17e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:43.562106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-7772b6f5-d359-415d-8d81-c22d9a3a5f84 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1366 microversion: 2.1 time: 0.505488 Aug 26 16:01:43.563564 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 362/743] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:43 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1366 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:43.595619 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-1623d86d-ed16-41d2-a580-7e731e1ac17e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Going to try to terminate instance {{(pid=128305) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 16:01:43.612937 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-508d3e5c-71bf-4003-9018-22681688037f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:43.613885 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-508d3e5c-71bf-4003-9018-22681688037f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:43.627619 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-508d3e5c-71bf-4003-9018-22681688037f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:43.629282 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-508d3e5c-71bf-4003-9018-22681688037f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:43.630068 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-508d3e5c-71bf-4003-9018-22681688037f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:43.632282 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-508d3e5c-71bf-4003-9018-22681688037f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:43.632860 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-508d3e5c-71bf-4003-9018-22681688037f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:43.633393 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-508d3e5c-71bf-4003-9018-22681688037f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:43.803576 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-508d3e5c-71bf-4003-9018-22681688037f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:43.813454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-508d3e5c-71bf-4003-9018-22681688037f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1723 microversion: 2.1 time: 0.206590 Aug 26 16:01:43.814038 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 363/744] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:43 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:43.849223 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-8a491f9c-b991-4257-bb54-0274c06e6a55 req-62fc0020-0089-47e8-bf72-2e080dd5c27d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f241a343-9b6e-471f-9a18-964d506fe4f3", "tag": "726f3f44-7d5b-426a-98ae-f35cdf9b45b9"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:01:43.860353 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-8a491f9c-b991-4257-bb54-0274c06e6a55 req-62fc0020-0089-47e8-bf72-2e080dd5c27d service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:43.860979 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-8a491f9c-b991-4257-bb54-0274c06e6a55 req-62fc0020-0089-47e8-bf72-2e080dd5c27d service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:43.863119 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-8a491f9c-b991-4257-bb54-0274c06e6a55 req-62fc0020-0089-47e8-bf72-2e080dd5c27d service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:43.880108 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-8a491f9c-b991-4257-bb54-0274c06e6a55 req-62fc0020-0089-47e8-bf72-2e080dd5c27d service nova] Creating event network-changed:726f3f44-7d5b-426a-98ae-f35cdf9b45b9 for instance f241a343-9b6e-471f-9a18-964d506fe4f3 on hv-cinder-85144 Aug 26 16:01:43.885763 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-8a491f9c-b991-4257-bb54-0274c06e6a55 req-62fc0020-0089-47e8-bf72-2e080dd5c27d service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040540 Aug 26 16:01:43.886676 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 364/745] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:01:44.024975 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-1623d86d-ed16-41d2-a580-7e731e1ac17e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "DELETE /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 204 len: 0 microversion: 2.20 time: 0.484834 Aug 26 16:01:44.034443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 382/746] 10.222.0.94 () {60 vars in 1280 bytes} [Fri Aug 26 16:01:43 2022] DELETE /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 26 16:01:44.035822 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-cf54d114-3c8c-4b70-8bf1-fc08549d8ed1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:44.036529 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-cf54d114-3c8c-4b70-8bf1-fc08549d8ed1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:44.044136 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cf54d114-3c8c-4b70-8bf1-fc08549d8ed1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:44.044974 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cf54d114-3c8c-4b70-8bf1-fc08549d8ed1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:44.045720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cf54d114-3c8c-4b70-8bf1-fc08549d8ed1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:44.046588 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cf54d114-3c8c-4b70-8bf1-fc08549d8ed1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:44.047378 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cf54d114-3c8c-4b70-8bf1-fc08549d8ed1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:44.048162 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cf54d114-3c8c-4b70-8bf1-fc08549d8ed1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:44.068918 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:01:44.114282 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-be471bf2-2d31-4e15-b109-13f19ee6d105 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:44.115061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-be471bf2-2d31-4e15-b109-13f19ee6d105 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:44.123765 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-be471bf2-2d31-4e15-b109-13f19ee6d105 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:44.124618 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-be471bf2-2d31-4e15-b109-13f19ee6d105 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:44.125325 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-be471bf2-2d31-4e15-b109-13f19ee6d105 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:44.127214 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-be471bf2-2d31-4e15-b109-13f19ee6d105 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:44.128001 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-be471bf2-2d31-4e15-b109-13f19ee6d105 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:44.128439 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-be471bf2-2d31-4e15-b109-13f19ee6d105 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:44.263748 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-cf54d114-3c8c-4b70-8bf1-fc08549d8ed1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:44.272585 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-cf54d114-3c8c-4b70-8bf1-fc08549d8ed1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:44.282982 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-cf54d114-3c8c-4b70-8bf1-fc08549d8ed1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:44.284554 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-cf54d114-3c8c-4b70-8bf1-fc08549d8ed1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.253486 Aug 26 16:01:44.285365 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 365/747] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:01:44 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:01:44.315850 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-be471bf2-2d31-4e15-b109-13f19ee6d105 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:44.325151 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-be471bf2-2d31-4e15-b109-13f19ee6d105 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1260 microversion: 2.1 time: 0.214960 Aug 26 16:01:44.325850 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 383/748] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:44 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1260 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:44.585232 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-6f31d85f-f830-4cb4-8dde-7cb73ef7ca3a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:44.585881 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-6f31d85f-f830-4cb4-8dde-7cb73ef7ca3a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:44.594661 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6f31d85f-f830-4cb4-8dde-7cb73ef7ca3a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:44.595194 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6f31d85f-f830-4cb4-8dde-7cb73ef7ca3a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:44.595642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6f31d85f-f830-4cb4-8dde-7cb73ef7ca3a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:44.596359 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6f31d85f-f830-4cb4-8dde-7cb73ef7ca3a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:44.596819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6f31d85f-f830-4cb4-8dde-7cb73ef7ca3a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:44.597490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6f31d85f-f830-4cb4-8dde-7cb73ef7ca3a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:44.745103 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-6f31d85f-f830-4cb4-8dde-7cb73ef7ca3a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:44.754391 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-6f31d85f-f830-4cb4-8dde-7cb73ef7ca3a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1366 microversion: 2.1 time: 0.172551 Aug 26 16:01:44.766843 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 366/749] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:44 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:44.839169 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-f9e5b0b1-b9ce-4921-abd2-99e89dfc8bd3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:44.840289 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-f9e5b0b1-b9ce-4921-abd2-99e89dfc8bd3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:44.846686 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f9e5b0b1-b9ce-4921-abd2-99e89dfc8bd3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:44.847352 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f9e5b0b1-b9ce-4921-abd2-99e89dfc8bd3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:44.848139 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f9e5b0b1-b9ce-4921-abd2-99e89dfc8bd3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:44.848886 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f9e5b0b1-b9ce-4921-abd2-99e89dfc8bd3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:44.849636 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f9e5b0b1-b9ce-4921-abd2-99e89dfc8bd3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:44.850070 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f9e5b0b1-b9ce-4921-abd2-99e89dfc8bd3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:45.010395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-f9e5b0b1-b9ce-4921-abd2-99e89dfc8bd3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:45.020334 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-f9e5b0b1-b9ce-4921-abd2-99e89dfc8bd3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1723 microversion: 2.1 time: 0.187570 Aug 26 16:01:45.025205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 384/750] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:44 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:45.313346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-2d0981c4-cf17-40c9-8a82-f6ddddb75cf9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:45.314152 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-2d0981c4-cf17-40c9-8a82-f6ddddb75cf9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:45.321481 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2d0981c4-cf17-40c9-8a82-f6ddddb75cf9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:45.321971 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2d0981c4-cf17-40c9-8a82-f6ddddb75cf9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:45.322408 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2d0981c4-cf17-40c9-8a82-f6ddddb75cf9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:45.323161 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2d0981c4-cf17-40c9-8a82-f6ddddb75cf9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:45.323655 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2d0981c4-cf17-40c9-8a82-f6ddddb75cf9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:45.324081 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2d0981c4-cf17-40c9-8a82-f6ddddb75cf9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:45.349304 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-27381526-9aa3-4ce6-b532-5f4bea5942ea tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:45.349304 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-27381526-9aa3-4ce6-b532-5f4bea5942ea tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:45.354715 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-27381526-9aa3-4ce6-b532-5f4bea5942ea tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:45.355587 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-27381526-9aa3-4ce6-b532-5f4bea5942ea tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:45.356109 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-27381526-9aa3-4ce6-b532-5f4bea5942ea tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:45.356941 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-27381526-9aa3-4ce6-b532-5f4bea5942ea tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:45.358126 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-27381526-9aa3-4ce6-b532-5f4bea5942ea tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:45.360932 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-27381526-9aa3-4ce6-b532-5f4bea5942ea tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:45.539108 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-2d0981c4-cf17-40c9-8a82-f6ddddb75cf9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:45.547427 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-2d0981c4-cf17-40c9-8a82-f6ddddb75cf9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:45.548881 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-2d0981c4-cf17-40c9-8a82-f6ddddb75cf9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:45.550111 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-2d0981c4-cf17-40c9-8a82-f6ddddb75cf9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.241114 Aug 26 16:01:45.550668 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 367/751] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:01:45 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:01:45.553322 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-27381526-9aa3-4ce6-b532-5f4bea5942ea tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:45.561972 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-27381526-9aa3-4ce6-b532-5f4bea5942ea tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1260 microversion: 2.1 time: 0.219322 Aug 26 16:01:45.562632 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 385/752] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:45 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1260 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:01:45.775273 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-24f4c88a-2b00-4979-81e2-76748aac49ab tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:45.775909 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-24f4c88a-2b00-4979-81e2-76748aac49ab tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:45.782077 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-24f4c88a-2b00-4979-81e2-76748aac49ab tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:45.782559 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-24f4c88a-2b00-4979-81e2-76748aac49ab tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:45.783020 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-24f4c88a-2b00-4979-81e2-76748aac49ab tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:45.783769 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-24f4c88a-2b00-4979-81e2-76748aac49ab tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:45.784257 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-24f4c88a-2b00-4979-81e2-76748aac49ab tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:45.784685 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-24f4c88a-2b00-4979-81e2-76748aac49ab tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:45.921925 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-24f4c88a-2b00-4979-81e2-76748aac49ab tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:45.929845 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-24f4c88a-2b00-4979-81e2-76748aac49ab tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1366 microversion: 2.1 time: 0.158599 Aug 26 16:01:45.930456 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 368/753] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:45 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:46.042376 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-4310dd2f-41ed-468b-b5b7-0b87bc73b204 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:46.043329 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-4310dd2f-41ed-468b-b5b7-0b87bc73b204 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:46.053000 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4310dd2f-41ed-468b-b5b7-0b87bc73b204 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:46.053574 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4310dd2f-41ed-468b-b5b7-0b87bc73b204 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:46.054084 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4310dd2f-41ed-468b-b5b7-0b87bc73b204 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:46.054860 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4310dd2f-41ed-468b-b5b7-0b87bc73b204 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:46.055412 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4310dd2f-41ed-468b-b5b7-0b87bc73b204 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:46.055932 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4310dd2f-41ed-468b-b5b7-0b87bc73b204 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:46.076837 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:01:46.206840 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-4310dd2f-41ed-468b-b5b7-0b87bc73b204 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:46.215211 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-4310dd2f-41ed-468b-b5b7-0b87bc73b204 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1723 microversion: 2.1 time: 0.176812 Aug 26 16:01:46.215810 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 386/754] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:46 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:46.575490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-660d476e-2058-423a-8a33-23974b7563d7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:46.576854 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-660d476e-2058-423a-8a33-23974b7563d7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:46.583460 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-660d476e-2058-423a-8a33-23974b7563d7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:46.583936 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-660d476e-2058-423a-8a33-23974b7563d7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:46.584369 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-660d476e-2058-423a-8a33-23974b7563d7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:46.585052 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-660d476e-2058-423a-8a33-23974b7563d7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:46.585497 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-660d476e-2058-423a-8a33-23974b7563d7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:46.596843 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-d76a1dbd-b65f-4629-9fa5-db2235a3e6ea tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:46.597307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-660d476e-2058-423a-8a33-23974b7563d7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:46.597413 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-d76a1dbd-b65f-4629-9fa5-db2235a3e6ea tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:46.597413 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d76a1dbd-b65f-4629-9fa5-db2235a3e6ea tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:46.597413 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d76a1dbd-b65f-4629-9fa5-db2235a3e6ea tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:46.597413 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d76a1dbd-b65f-4629-9fa5-db2235a3e6ea tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:46.597698 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d76a1dbd-b65f-4629-9fa5-db2235a3e6ea tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:46.597698 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d76a1dbd-b65f-4629-9fa5-db2235a3e6ea tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:46.597698 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d76a1dbd-b65f-4629-9fa5-db2235a3e6ea tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:46.785184 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-660d476e-2058-423a-8a33-23974b7563d7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:46.790084 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d76a1dbd-b65f-4629-9fa5-db2235a3e6ea tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:46.795157 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-660d476e-2058-423a-8a33-23974b7563d7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:46.796832 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-660d476e-2058-423a-8a33-23974b7563d7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:46.798027 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-660d476e-2058-423a-8a33-23974b7563d7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.226872 Aug 26 16:01:46.798634 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 369/755] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:01:46 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:01:46.799880 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-d76a1dbd-b65f-4629-9fa5-db2235a3e6ea tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1260 microversion: 2.1 time: 0.217534 Aug 26 16:01:46.800859 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 387/756] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:46 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1260 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:01:46.892176 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-c653743e-bd98-4bbc-b650-6f80f52e3315 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Action: 'create', calling method: .version_select at 0x7f15d9513d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1729566069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFV2kwCmAzLPD1owNm4raReUDyueFWlD7vlvcCho57/Cvr1cRVFyT3sOsA69jCZQY3kuLuQW+3wrG/SZ1X0sHPexiA5aCA6fPrcJSLjTXrAsc6U9gh5/6eELCbfCYjUZbw=="}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:01:46.897486 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell0:SELECT=4 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:01:46.904104 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell0:SELECT=14 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:01:46.908879 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-c653743e-bd98-4bbc-b650-6f80f52e3315 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Getting quotas for project 070e0f497888488d863e2f63b87a31ff. Resources: {'key_pairs'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 16:01:46.912650 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-c653743e-bd98-4bbc-b650-6f80f52e3315 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Getting quotas for user 36d61fd7e97d433e886aaf495f703751 and project 070e0f497888488d863e2f63b87a31ff. Resources: {'key_pairs'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 16:01:46.950759 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-e4b8ef05-8f62-419c-9a51-d954ca46cae4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:46.951570 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-e4b8ef05-8f62-419c-9a51-d954ca46cae4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:46.957522 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e4b8ef05-8f62-419c-9a51-d954ca46cae4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:46.958003 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e4b8ef05-8f62-419c-9a51-d954ca46cae4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:46.958437 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e4b8ef05-8f62-419c-9a51-d954ca46cae4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:46.959371 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e4b8ef05-8f62-419c-9a51-d954ca46cae4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:46.959826 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e4b8ef05-8f62-419c-9a51-d954ca46cae4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:46.960258 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e4b8ef05-8f62-419c-9a51-d954ca46cae4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:47.054911 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-c653743e-bd98-4bbc-b650-6f80f52e3315 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.166677 Aug 26 16:01:47.055610 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 370/757] 10.222.0.94 () {60 vars in 1159 bytes} [Fri Aug 26 16:01:46 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:01:47.092725 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-e4b8ef05-8f62-419c-9a51-d954ca46cae4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:47.100613 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-e4b8ef05-8f62-419c-9a51-d954ca46cae4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1366 microversion: 2.1 time: 0.153764 Aug 26 16:01:47.101184 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 388/758] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:46 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:47.109786 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7d98d3e0-b404-49c9-95a8-44890b045378 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1259538834", "imageRef": "cf053bc3-03ae-4d62-8445-4364a6753eda", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1729566069", "networks": [{"uuid": "fa77b427-b5ba-48e9-b163-929f4df0a43c"}]}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:01:47.118151 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:01:47.163601 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.network.neutron [None req-7d98d3e0-b404-49c9-95a8-44890b045378 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] validate_networks() for [('fa77b427-b5ba-48e9-b163-929f4df0a43c', None, None, None, None, None)] {{(pid=128304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 16:01:47.241484 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell0:SELECT=8 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:01:47.294066 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-2273d133-6144-4288-befb-3f20bd1d61eb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:47.295469 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-2273d133-6144-4288-befb-3f20bd1d61eb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:47.301617 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2273d133-6144-4288-befb-3f20bd1d61eb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:47.305495 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2273d133-6144-4288-befb-3f20bd1d61eb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:47.305495 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2273d133-6144-4288-befb-3f20bd1d61eb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:47.305495 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2273d133-6144-4288-befb-3f20bd1d61eb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:47.305495 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2273d133-6144-4288-befb-3f20bd1d61eb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:47.305968 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2273d133-6144-4288-befb-3f20bd1d61eb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:47.686559 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-2273d133-6144-4288-befb-3f20bd1d61eb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:47.702008 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-2273d133-6144-4288-befb-3f20bd1d61eb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1723 microversion: 2.1 time: 0.470075 Aug 26 16:01:47.702592 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 389/759] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:47 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1723 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:01:47.821845 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-52ac7aa8-6e89-4078-b2df-96f85e315b30 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:47.822622 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-52ac7aa8-6e89-4078-b2df-96f85e315b30 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:47.829625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-52ac7aa8-6e89-4078-b2df-96f85e315b30 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:47.830369 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-52ac7aa8-6e89-4078-b2df-96f85e315b30 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:47.830807 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-52ac7aa8-6e89-4078-b2df-96f85e315b30 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:47.831526 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-52ac7aa8-6e89-4078-b2df-96f85e315b30 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:47.833997 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-52ac7aa8-6e89-4078-b2df-96f85e315b30 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:47.833997 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-52ac7aa8-6e89-4078-b2df-96f85e315b30 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:47.929748 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-7d98d3e0-b404-49c9-95a8-44890b045378 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Flavor limits 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 16:01:47.932118 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-7d98d3e0-b404-49c9-95a8-44890b045378 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Image limits 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 16:01:47.932118 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-7d98d3e0-b404-49c9-95a8-44890b045378 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Flavor pref 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 16:01:47.932118 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-7d98d3e0-b404-49c9-95a8-44890b045378 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Image pref 0:0:0 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 16:01:47.932118 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.virt.hardware [None req-7d98d3e0-b404-49c9-95a8-44890b045378 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 16:01:47.941500 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7d98d3e0-b404-49c9-95a8-44890b045378 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:47.941984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7d98d3e0-b404-49c9-95a8-44890b045378 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:47.942427 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7d98d3e0-b404-49c9-95a8-44890b045378 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:47.943206 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7d98d3e0-b404-49c9-95a8-44890b045378 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:47.943694 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7d98d3e0-b404-49c9-95a8-44890b045378 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:47.944124 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7d98d3e0-b404-49c9-95a8-44890b045378 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:47.963090 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-7d98d3e0-b404-49c9-95a8-44890b045378 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Getting quotas for project 070e0f497888488d863e2f63b87a31ff. Resources: {'instances', 'ram', 'cores'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 16:01:47.968806 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-7d98d3e0-b404-49c9-95a8-44890b045378 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Getting quotas for user 36d61fd7e97d433e886aaf495f703751 and project 070e0f497888488d863e2f63b87a31ff. Resources: {'instances', 'ram', 'cores'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 16:01:47.982943 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-7d98d3e0-b404-49c9-95a8-44890b045378 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Going to run 1 instances... {{(pid=128304) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 16:01:47.985183 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-7d98d3e0-b404-49c9-95a8-44890b045378 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cf053bc3-03ae-4d62-8445-4364a6753eda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 16:01:47.988669 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-52ac7aa8-6e89-4078-b2df-96f85e315b30 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:47.996696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-52ac7aa8-6e89-4078-b2df-96f85e315b30 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:47.998598 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-52ac7aa8-6e89-4078-b2df-96f85e315b30 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:47.999816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-52ac7aa8-6e89-4078-b2df-96f85e315b30 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.182179 Aug 26 16:01:48.003046 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 390/760] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:01:47 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:01:48.005100 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-da2db625-fef0-4961-bb2b-a14976c54550 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:48.005526 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-da2db625-fef0-4961-bb2b-a14976c54550 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:48.011490 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-da2db625-fef0-4961-bb2b-a14976c54550 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:48.012120 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-da2db625-fef0-4961-bb2b-a14976c54550 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:48.012416 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-da2db625-fef0-4961-bb2b-a14976c54550 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:48.013865 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-da2db625-fef0-4961-bb2b-a14976c54550 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:48.014315 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-da2db625-fef0-4961-bb2b-a14976c54550 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:48.014734 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-da2db625-fef0-4961-bb2b-a14976c54550 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:48.118362 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-7d98d3e0-b404-49c9-95a8-44890b045378 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.013327 Aug 26 16:01:48.121572 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 371/761] 10.222.0.94 () {60 vars in 1147 bytes} [Fri Aug 26 16:01:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 16:01:48.125126 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-cb2aefd7-9607-4aa7-b3ee-de659e14ceee tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:48.126059 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-cb2aefd7-9607-4aa7-b3ee-de659e14ceee tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:48.132664 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cb2aefd7-9607-4aa7-b3ee-de659e14ceee tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:48.133237 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cb2aefd7-9607-4aa7-b3ee-de659e14ceee tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:48.133932 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cb2aefd7-9607-4aa7-b3ee-de659e14ceee tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:48.134714 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cb2aefd7-9607-4aa7-b3ee-de659e14ceee tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:48.135401 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cb2aefd7-9607-4aa7-b3ee-de659e14ceee tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:48.136029 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cb2aefd7-9607-4aa7-b3ee-de659e14ceee tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:48.165093 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-da2db625-fef0-4961-bb2b-a14976c54550 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:48.177866 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-da2db625-fef0-4961-bb2b-a14976c54550 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1260 microversion: 2.1 time: 0.175765 Aug 26 16:01:48.191568 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 391/762] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:48 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:48.197324 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-99c58e75-98e2-426f-9fe6-466d348c7b6f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:48.197955 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-99c58e75-98e2-426f-9fe6-466d348c7b6f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:48.276408 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-99c58e75-98e2-426f-9fe6-466d348c7b6f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:48.283240 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-99c58e75-98e2-426f-9fe6-466d348c7b6f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1259 microversion: 2.1 time: 0.090420 Aug 26 16:01:48.283812 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 392/763] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:48 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1259 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:48.343427 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-cb2aefd7-9607-4aa7-b3ee-de659e14ceee tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:48.351100 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-cb2aefd7-9607-4aa7-b3ee-de659e14ceee tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1366 microversion: 2.1 time: 0.230776 Aug 26 16:01:48.351669 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 372/764] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:48 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:48.723225 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-abc68259-f00a-4a9d-b5d9-98170648d1a0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:48.723823 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-abc68259-f00a-4a9d-b5d9-98170648d1a0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:48.729709 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-abc68259-f00a-4a9d-b5d9-98170648d1a0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:48.730180 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-abc68259-f00a-4a9d-b5d9-98170648d1a0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:48.730603 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-abc68259-f00a-4a9d-b5d9-98170648d1a0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:48.731312 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-abc68259-f00a-4a9d-b5d9-98170648d1a0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:48.732518 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-abc68259-f00a-4a9d-b5d9-98170648d1a0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:48.732952 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-abc68259-f00a-4a9d-b5d9-98170648d1a0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:48.874036 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-abc68259-f00a-4a9d-b5d9-98170648d1a0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:48.882248 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-abc68259-f00a-4a9d-b5d9-98170648d1a0 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1723 microversion: 2.1 time: 0.162819 Aug 26 16:01:48.882803 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 393/765] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:48 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:49.023288 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-14056c87-68be-4991-97ab-a25c9c3dc0a9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:49.023820 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-14056c87-68be-4991-97ab-a25c9c3dc0a9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:49.031043 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-14056c87-68be-4991-97ab-a25c9c3dc0a9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:49.031530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-14056c87-68be-4991-97ab-a25c9c3dc0a9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:49.031973 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-14056c87-68be-4991-97ab-a25c9c3dc0a9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:49.032665 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-14056c87-68be-4991-97ab-a25c9c3dc0a9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:49.033125 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-14056c87-68be-4991-97ab-a25c9c3dc0a9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:49.033553 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-14056c87-68be-4991-97ab-a25c9c3dc0a9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:49.171738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-14056c87-68be-4991-97ab-a25c9c3dc0a9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:49.179925 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-14056c87-68be-4991-97ab-a25c9c3dc0a9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:49.181341 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-14056c87-68be-4991-97ab-a25c9c3dc0a9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:49.182527 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-14056c87-68be-4991-97ab-a25c9c3dc0a9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.163305 Aug 26 16:01:49.183108 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 373/766] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:01:49 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:01:49.202459 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-954a30e4-d65c-46ca-bd21-b567c29589d9 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:49.203096 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-954a30e4-d65c-46ca-bd21-b567c29589d9 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:49.209570 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-954a30e4-d65c-46ca-bd21-b567c29589d9 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:49.210045 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-954a30e4-d65c-46ca-bd21-b567c29589d9 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:49.210478 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-954a30e4-d65c-46ca-bd21-b567c29589d9 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:49.211194 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-954a30e4-d65c-46ca-bd21-b567c29589d9 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:49.211655 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-954a30e4-d65c-46ca-bd21-b567c29589d9 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:49.212079 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-954a30e4-d65c-46ca-bd21-b567c29589d9 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:49.304824 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-11c49a7e-1275-41c2-9850-d56b655f242c tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:49.305553 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-11c49a7e-1275-41c2-9850-d56b655f242c tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:49.368650 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-11c49a7e-1275-41c2-9850-d56b655f242c tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:49.373156 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-954a30e4-d65c-46ca-bd21-b567c29589d9 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:49.377594 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-11c49a7e-1275-41c2-9850-d56b655f242c tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1259 microversion: 2.1 time: 0.076717 Aug 26 16:01:49.382747 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 374/767] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:49 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1259 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:01:49.382854 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-954a30e4-d65c-46ca-bd21-b567c29589d9 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1260 microversion: 2.1 time: 0.183398 Aug 26 16:01:49.382854 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 394/768] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:49 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:49.383063 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-83f8e2f1-b33c-4a18-bab1-339e712644dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:49.383262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-83f8e2f1-b33c-4a18-bab1-339e712644dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:49.390694 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-83f8e2f1-b33c-4a18-bab1-339e712644dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:49.391251 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-83f8e2f1-b33c-4a18-bab1-339e712644dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:49.391683 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-83f8e2f1-b33c-4a18-bab1-339e712644dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:49.392417 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-83f8e2f1-b33c-4a18-bab1-339e712644dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:49.392870 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-83f8e2f1-b33c-4a18-bab1-339e712644dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:49.393331 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-83f8e2f1-b33c-4a18-bab1-339e712644dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:49.528726 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-83f8e2f1-b33c-4a18-bab1-339e712644dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:49.536462 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-83f8e2f1-b33c-4a18-bab1-339e712644dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1366 microversion: 2.1 time: 0.157316 Aug 26 16:01:49.537028 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 375/769] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:49 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:49.904125 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-63133572-05de-41b3-a437-ca1a261b9f7b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:49.904805 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-63133572-05de-41b3-a437-ca1a261b9f7b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:49.910747 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63133572-05de-41b3-a437-ca1a261b9f7b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:49.911260 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63133572-05de-41b3-a437-ca1a261b9f7b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:49.911688 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63133572-05de-41b3-a437-ca1a261b9f7b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:49.912405 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63133572-05de-41b3-a437-ca1a261b9f7b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:49.913007 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63133572-05de-41b3-a437-ca1a261b9f7b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:49.913429 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63133572-05de-41b3-a437-ca1a261b9f7b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:50.048242 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-63133572-05de-41b3-a437-ca1a261b9f7b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:50.056344 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-63133572-05de-41b3-a437-ca1a261b9f7b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1729 microversion: 2.1 time: 0.156472 Aug 26 16:01:50.056911 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 395/770] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:49 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:50.087411 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-53f3031d-c49c-470c-9205-2f333d0a9eca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:50.087970 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-53f3031d-c49c-470c-9205-2f333d0a9eca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:50.094528 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-53f3031d-c49c-470c-9205-2f333d0a9eca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:50.094986 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-53f3031d-c49c-470c-9205-2f333d0a9eca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:50.095433 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-53f3031d-c49c-470c-9205-2f333d0a9eca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:50.096219 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-53f3031d-c49c-470c-9205-2f333d0a9eca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:50.096677 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-53f3031d-c49c-470c-9205-2f333d0a9eca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:50.097108 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-53f3031d-c49c-470c-9205-2f333d0a9eca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:50.182798 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-53f3031d-c49c-470c-9205-2f333d0a9eca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099074 Aug 26 16:01:50.183443 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 376/771] 10.222.0.94 () {58 vars in 1275 bytes} [Fri Aug 26 16:01:50 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:01:50.206306 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-ca4ad3d6-4a9e-43d1-9520-29431ab6049e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:50.206912 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-ca4ad3d6-4a9e-43d1-9520-29431ab6049e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:50.213308 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ca4ad3d6-4a9e-43d1-9520-29431ab6049e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:50.213792 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ca4ad3d6-4a9e-43d1-9520-29431ab6049e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:50.214228 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ca4ad3d6-4a9e-43d1-9520-29431ab6049e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:50.214935 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ca4ad3d6-4a9e-43d1-9520-29431ab6049e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:50.215388 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ca4ad3d6-4a9e-43d1-9520-29431ab6049e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:50.215817 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ca4ad3d6-4a9e-43d1-9520-29431ab6049e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:50.399411 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-90f9fc4d-4f1b-4f50-b4e4-b8856bb08f33 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:50.400260 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-90f9fc4d-4f1b-4f50-b4e4-b8856bb08f33 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:50.407346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-90f9fc4d-4f1b-4f50-b4e4-b8856bb08f33 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:50.407828 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-90f9fc4d-4f1b-4f50-b4e4-b8856bb08f33 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:50.408260 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-90f9fc4d-4f1b-4f50-b4e4-b8856bb08f33 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:50.408955 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-90f9fc4d-4f1b-4f50-b4e4-b8856bb08f33 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:50.409403 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-90f9fc4d-4f1b-4f50-b4e4-b8856bb08f33 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:50.409820 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-90f9fc4d-4f1b-4f50-b4e4-b8856bb08f33 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:50.456583 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-ca4ad3d6-4a9e-43d1-9520-29431ab6049e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:50.465425 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-ca4ad3d6-4a9e-43d1-9520-29431ab6049e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:50.466969 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-ca4ad3d6-4a9e-43d1-9520-29431ab6049e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:50.468149 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-ca4ad3d6-4a9e-43d1-9520-29431ab6049e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1725 microversion: 2.20 time: 0.265783 Aug 26 16:01:50.468715 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 396/772] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:01:50 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1725 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:01:50.473055 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-7a5e4ed4-f780-4faf-8a46-1bc154ebc336 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:50.473655 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-7a5e4ed4-f780-4faf-8a46-1bc154ebc336 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:50.479528 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7a5e4ed4-f780-4faf-8a46-1bc154ebc336 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:50.479981 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7a5e4ed4-f780-4faf-8a46-1bc154ebc336 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:50.480412 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7a5e4ed4-f780-4faf-8a46-1bc154ebc336 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:50.481554 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7a5e4ed4-f780-4faf-8a46-1bc154ebc336 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:50.481554 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7a5e4ed4-f780-4faf-8a46-1bc154ebc336 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:50.482526 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7a5e4ed4-f780-4faf-8a46-1bc154ebc336 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:50.486901 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-90f9fc4d-4f1b-4f50-b4e4-b8856bb08f33 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:50.495328 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-90f9fc4d-4f1b-4f50-b4e4-b8856bb08f33 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1263 microversion: 2.1 time: 0.099881 Aug 26 16:01:50.495923 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 377/773] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:50 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1263 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:50.557370 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-babb3524-3b76-4e04-acd2-ba8c278a930f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:50.558117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-babb3524-3b76-4e04-acd2-ba8c278a930f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:50.565338 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-babb3524-3b76-4e04-acd2-ba8c278a930f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:50.565831 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-babb3524-3b76-4e04-acd2-ba8c278a930f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:50.566270 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-babb3524-3b76-4e04-acd2-ba8c278a930f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:50.567139 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-babb3524-3b76-4e04-acd2-ba8c278a930f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:50.567804 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-babb3524-3b76-4e04-acd2-ba8c278a930f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:50.568230 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-babb3524-3b76-4e04-acd2-ba8c278a930f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:50.851575 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-7a5e4ed4-f780-4faf-8a46-1bc154ebc336 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:50.860970 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-7a5e4ed4-f780-4faf-8a46-1bc154ebc336 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1260 microversion: 2.1 time: 0.391092 Aug 26 16:01:50.868454 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 397/774] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:50 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1260 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:50.960813 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-babb3524-3b76-4e04-acd2-ba8c278a930f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:50.969530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-babb3524-3b76-4e04-acd2-ba8c278a930f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1366 microversion: 2.1 time: 0.416062 Aug 26 16:01:50.983336 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 378/775] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:50 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1366 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:01:51.492889 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a1bb84d2-a9bc-4a82-aedc-f4cee473e750 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:51.493835 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a1bb84d2-a9bc-4a82-aedc-f4cee473e750 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:51.502135 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a1bb84d2-a9bc-4a82-aedc-f4cee473e750 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:51.502651 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a1bb84d2-a9bc-4a82-aedc-f4cee473e750 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:51.503123 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a1bb84d2-a9bc-4a82-aedc-f4cee473e750 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:51.503827 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a1bb84d2-a9bc-4a82-aedc-f4cee473e750 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:51.504531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a1bb84d2-a9bc-4a82-aedc-f4cee473e750 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:51.504961 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a1bb84d2-a9bc-4a82-aedc-f4cee473e750 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:51.518022 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-b7282e08-6bea-469f-9761-5cbf1ad13dfb tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:51.519377 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-b7282e08-6bea-469f-9761-5cbf1ad13dfb tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:51.526591 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b7282e08-6bea-469f-9761-5cbf1ad13dfb tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:51.527342 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b7282e08-6bea-469f-9761-5cbf1ad13dfb tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:51.528006 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b7282e08-6bea-469f-9761-5cbf1ad13dfb tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:51.528892 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b7282e08-6bea-469f-9761-5cbf1ad13dfb tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:51.529565 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b7282e08-6bea-469f-9761-5cbf1ad13dfb tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:51.530001 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b7282e08-6bea-469f-9761-5cbf1ad13dfb tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:51.677144 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a1bb84d2-a9bc-4a82-aedc-f4cee473e750 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:51.687013 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a1bb84d2-a9bc-4a82-aedc-f4cee473e750 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:51.687833 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-b7282e08-6bea-469f-9761-5cbf1ad13dfb tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:51.689048 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a1bb84d2-a9bc-4a82-aedc-f4cee473e750 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:51.690539 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a1bb84d2-a9bc-4a82-aedc-f4cee473e750 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1657 microversion: 2.20 time: 0.201919 Aug 26 16:01:51.691804 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 398/776] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:01:51 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1657 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:01:51.705142 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-b7282e08-6bea-469f-9761-5cbf1ad13dfb tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1255 microversion: 2.1 time: 0.192624 Aug 26 16:01:51.705846 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 379/777] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:51 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1255 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:51.870625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-79492073-496f-4664-b190-fc3d38c984ca req-70bbb0b9-e5df-4047-ac44-a49e2f6a13f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac977a7-aa08-459a-a863-36ba667422d1", "name": "network-vif-deleted", "tag": "8a53b00a-319e-4368-a0b0-216d2f508b1d"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:01:51.882291 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-3890f657-a42e-4ec3-8377-b46683c6ac11 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:51.883506 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-3890f657-a42e-4ec3-8377-b46683c6ac11 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:51.892951 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-79492073-496f-4664-b190-fc3d38c984ca req-70bbb0b9-e5df-4047-ac44-a49e2f6a13f3 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:51.893331 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-79492073-496f-4664-b190-fc3d38c984ca req-70bbb0b9-e5df-4047-ac44-a49e2f6a13f3 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:51.897233 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-79492073-496f-4664-b190-fc3d38c984ca req-70bbb0b9-e5df-4047-ac44-a49e2f6a13f3 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:51.918639 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-79492073-496f-4664-b190-fc3d38c984ca req-70bbb0b9-e5df-4047-ac44-a49e2f6a13f3 service nova] Creating event network-vif-deleted:8a53b00a-319e-4368-a0b0-216d2f508b1d for instance 8ac977a7-aa08-459a-a863-36ba667422d1 on hv-cinder-85144 Aug 26 16:01:51.925910 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3890f657-a42e-4ec3-8377-b46683c6ac11 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:51.928315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3890f657-a42e-4ec3-8377-b46683c6ac11 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:51.929303 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-79492073-496f-4664-b190-fc3d38c984ca req-70bbb0b9-e5df-4047-ac44-a49e2f6a13f3 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064727 Aug 26 16:01:51.930414 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 399/778] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:01:51.932349 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3890f657-a42e-4ec3-8377-b46683c6ac11 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:51.933754 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3890f657-a42e-4ec3-8377-b46683c6ac11 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:51.937910 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3890f657-a42e-4ec3-8377-b46683c6ac11 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:51.946552 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3890f657-a42e-4ec3-8377-b46683c6ac11 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:51.993247 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-2ab9f4a5-3979-4cef-bbcc-73c2d205eac3 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:51.994162 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-2ab9f4a5-3979-4cef-bbcc-73c2d205eac3 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:52.005830 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2ab9f4a5-3979-4cef-bbcc-73c2d205eac3 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:52.007557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2ab9f4a5-3979-4cef-bbcc-73c2d205eac3 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:52.014660 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2ab9f4a5-3979-4cef-bbcc-73c2d205eac3 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:52.014660 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2ab9f4a5-3979-4cef-bbcc-73c2d205eac3 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:52.014660 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2ab9f4a5-3979-4cef-bbcc-73c2d205eac3 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:52.014660 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2ab9f4a5-3979-4cef-bbcc-73c2d205eac3 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:52.371474 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-3890f657-a42e-4ec3-8377-b46683c6ac11 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:52.381343 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-3890f657-a42e-4ec3-8377-b46683c6ac11 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1260 microversion: 2.1 time: 0.503482 Aug 26 16:01:52.385790 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 380/779] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:51 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1260 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:01:52.395350 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-38d0ef07-14f0-49e5-ab69-8f57ff6b3639 req-7035f1db-6af9-4d25-b07b-8ab82a5c642d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "842d5015-aa0d-46a5-8162-7201b4277653", "tag": "3b2c5b8a-cb44-484c-9531-c39f763ffef9"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:01:52.408917 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-38d0ef07-14f0-49e5-ab69-8f57ff6b3639 req-7035f1db-6af9-4d25-b07b-8ab82a5c642d service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:52.409718 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-38d0ef07-14f0-49e5-ab69-8f57ff6b3639 req-7035f1db-6af9-4d25-b07b-8ab82a5c642d service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:52.410386 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-38d0ef07-14f0-49e5-ab69-8f57ff6b3639 req-7035f1db-6af9-4d25-b07b-8ab82a5c642d service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:52.433237 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-38d0ef07-14f0-49e5-ab69-8f57ff6b3639 req-7035f1db-6af9-4d25-b07b-8ab82a5c642d service nova] Creating event network-changed:3b2c5b8a-cb44-484c-9531-c39f763ffef9 for instance 842d5015-aa0d-46a5-8162-7201b4277653 on hv-cinder-85144 Aug 26 16:01:52.449877 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-38d0ef07-14f0-49e5-ab69-8f57ff6b3639 req-7035f1db-6af9-4d25-b07b-8ab82a5c642d service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061429 Aug 26 16:01:52.453413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 381/780] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:01:52.476941 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-2ab9f4a5-3979-4cef-bbcc-73c2d205eac3 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:52.500052 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-2ab9f4a5-3979-4cef-bbcc-73c2d205eac3 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1366 microversion: 2.1 time: 0.511030 Aug 26 16:01:52.500989 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 400/781] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:51 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1366 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:52.717591 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-54966400-1ef7-40bc-a811-d6214344195d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:52.718347 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-54966400-1ef7-40bc-a811-d6214344195d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:52.727697 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-54966400-1ef7-40bc-a811-d6214344195d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:52.727917 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-d0b670d4-ddda-443d-92e1-6d255afb6eb0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:52.728577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-54966400-1ef7-40bc-a811-d6214344195d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:52.729216 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-d0b670d4-ddda-443d-92e1-6d255afb6eb0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:52.729545 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-54966400-1ef7-40bc-a811-d6214344195d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:52.730484 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-54966400-1ef7-40bc-a811-d6214344195d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:52.731419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-54966400-1ef7-40bc-a811-d6214344195d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:52.732002 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-54966400-1ef7-40bc-a811-d6214344195d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:52.736575 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d0b670d4-ddda-443d-92e1-6d255afb6eb0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:52.737345 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d0b670d4-ddda-443d-92e1-6d255afb6eb0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:52.737869 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d0b670d4-ddda-443d-92e1-6d255afb6eb0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:52.738690 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d0b670d4-ddda-443d-92e1-6d255afb6eb0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:52.739280 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d0b670d4-ddda-443d-92e1-6d255afb6eb0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:52.739803 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d0b670d4-ddda-443d-92e1-6d255afb6eb0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:52.796084 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-54966400-1ef7-40bc-a811-d6214344195d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:52.798136 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-54966400-1ef7-40bc-a811-d6214344195d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:52.798604 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-54966400-1ef7-40bc-a811-d6214344195d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:52.799849 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.objects.instance [None req-54966400-1ef7-40bc-a811-d6214344195d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lazy-loading 'fault' on Instance uuid 8ac977a7-aa08-459a-a863-36ba667422d1 {{(pid=128304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:01:52.962760 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d0b670d4-ddda-443d-92e1-6d255afb6eb0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:52.983820 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-d0b670d4-ddda-443d-92e1-6d255afb6eb0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1311 microversion: 2.1 time: 0.258796 Aug 26 16:01:52.986662 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 401/782] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:52 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1311 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:01:53.013911 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-54966400-1ef7-40bc-a811-d6214344195d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:53.049105 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-54966400-1ef7-40bc-a811-d6214344195d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:53.051924 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-54966400-1ef7-40bc-a811-d6214344195d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:53.054443 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-54966400-1ef7-40bc-a811-d6214344195d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1372 microversion: 2.20 time: 0.344081 Aug 26 16:01:53.069691 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 382/783] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:01:52 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1372 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:01:53.418112 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-56264ff0-72b3-4085-90c4-62b7f85b6829 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:53.423163 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-56264ff0-72b3-4085-90c4-62b7f85b6829 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:53.434020 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-56264ff0-72b3-4085-90c4-62b7f85b6829 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:53.434718 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-56264ff0-72b3-4085-90c4-62b7f85b6829 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:53.435732 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-56264ff0-72b3-4085-90c4-62b7f85b6829 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:53.436533 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-56264ff0-72b3-4085-90c4-62b7f85b6829 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:53.437086 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-56264ff0-72b3-4085-90c4-62b7f85b6829 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:53.437582 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-56264ff0-72b3-4085-90c4-62b7f85b6829 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:53.520770 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-0c13b056-18ee-4e6a-b3f5-fe3c45fcc12b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:53.521481 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-0c13b056-18ee-4e6a-b3f5-fe3c45fcc12b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:53.528170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0c13b056-18ee-4e6a-b3f5-fe3c45fcc12b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:53.528842 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0c13b056-18ee-4e6a-b3f5-fe3c45fcc12b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:53.529300 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0c13b056-18ee-4e6a-b3f5-fe3c45fcc12b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:53.530080 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0c13b056-18ee-4e6a-b3f5-fe3c45fcc12b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:53.530664 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0c13b056-18ee-4e6a-b3f5-fe3c45fcc12b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:53.531168 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0c13b056-18ee-4e6a-b3f5-fe3c45fcc12b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:53.590132 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-56264ff0-72b3-4085-90c4-62b7f85b6829 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:53.599007 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-56264ff0-72b3-4085-90c4-62b7f85b6829 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1260 microversion: 2.1 time: 0.185871 Aug 26 16:01:53.604267 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 402/784] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:53 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:53.675538 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-0c13b056-18ee-4e6a-b3f5-fe3c45fcc12b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:53.683258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-0c13b056-18ee-4e6a-b3f5-fe3c45fcc12b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1366 microversion: 2.1 time: 0.166427 Aug 26 16:01:53.684553 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 383/785] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:53 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:01:54.001934 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a3beb66f-7461-42a7-a59f-eb177fd1d60b tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:54.002544 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a3beb66f-7461-42a7-a59f-eb177fd1d60b tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:54.008970 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a3beb66f-7461-42a7-a59f-eb177fd1d60b tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:54.009451 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a3beb66f-7461-42a7-a59f-eb177fd1d60b tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:54.009883 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a3beb66f-7461-42a7-a59f-eb177fd1d60b tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:54.010568 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a3beb66f-7461-42a7-a59f-eb177fd1d60b tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:54.011052 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a3beb66f-7461-42a7-a59f-eb177fd1d60b tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:54.011483 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a3beb66f-7461-42a7-a59f-eb177fd1d60b tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:54.077984 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a3beb66f-7461-42a7-a59f-eb177fd1d60b tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:54.082562 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-5c2ed45a-59a9-488a-9eac-cc0efb2166cd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:54.083215 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-5c2ed45a-59a9-488a-9eac-cc0efb2166cd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:54.085781 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a3beb66f-7461-42a7-a59f-eb177fd1d60b tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1319 microversion: 2.1 time: 0.087662 Aug 26 16:01:54.086351 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 403/786] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:53 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1319 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:54.089900 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5c2ed45a-59a9-488a-9eac-cc0efb2166cd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:54.090385 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5c2ed45a-59a9-488a-9eac-cc0efb2166cd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:54.090860 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5c2ed45a-59a9-488a-9eac-cc0efb2166cd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:54.092797 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5c2ed45a-59a9-488a-9eac-cc0efb2166cd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:54.093258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5c2ed45a-59a9-488a-9eac-cc0efb2166cd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:54.093686 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5c2ed45a-59a9-488a-9eac-cc0efb2166cd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:54.125145 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5c2ed45a-59a9-488a-9eac-cc0efb2166cd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:54.125621 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5c2ed45a-59a9-488a-9eac-cc0efb2166cd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:54.126053 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5c2ed45a-59a9-488a-9eac-cc0efb2166cd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:54.126506 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.objects.instance [None req-5c2ed45a-59a9-488a-9eac-cc0efb2166cd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lazy-loading 'fault' on Instance uuid 8ac977a7-aa08-459a-a863-36ba667422d1 {{(pid=128304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:01:54.535662 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-ababf5fa-4a93-4392-a7c6-ab6510866c21 req-b9fb7af1-32eb-4bb9-bda5-5e00f06e0de8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "842d5015-aa0d-46a5-8162-7201b4277653", "tag": "3b2c5b8a-cb44-484c-9531-c39f763ffef9"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:01:54.544869 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-5c2ed45a-59a9-488a-9eac-cc0efb2166cd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:54.546567 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-ababf5fa-4a93-4392-a7c6-ab6510866c21 req-b9fb7af1-32eb-4bb9-bda5-5e00f06e0de8 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:54.547095 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-ababf5fa-4a93-4392-a7c6-ab6510866c21 req-b9fb7af1-32eb-4bb9-bda5-5e00f06e0de8 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:54.547505 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-ababf5fa-4a93-4392-a7c6-ab6510866c21 req-b9fb7af1-32eb-4bb9-bda5-5e00f06e0de8 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:54.555289 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-5c2ed45a-59a9-488a-9eac-cc0efb2166cd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:54.557075 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-5c2ed45a-59a9-488a-9eac-cc0efb2166cd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:54.558448 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-5c2ed45a-59a9-488a-9eac-cc0efb2166cd tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 200 len: 1372 microversion: 2.20 time: 0.479738 Aug 26 16:01:54.559514 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 384/787] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:01:54 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 1372 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:01:54.565999 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-ababf5fa-4a93-4392-a7c6-ab6510866c21 req-b9fb7af1-32eb-4bb9-bda5-5e00f06e0de8 service nova] Creating event network-changed:3b2c5b8a-cb44-484c-9531-c39f763ffef9 for instance 842d5015-aa0d-46a5-8162-7201b4277653 on hv-cinder-85144 Aug 26 16:01:54.577096 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-ababf5fa-4a93-4392-a7c6-ab6510866c21 req-b9fb7af1-32eb-4bb9-bda5-5e00f06e0de8 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045206 Aug 26 16:01:54.578690 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 404/788] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:01:54.619104 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-5d472876-b259-45bc-b605-4fd009421af2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:54.622746 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-5d472876-b259-45bc-b605-4fd009421af2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:54.626110 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d472876-b259-45bc-b605-4fd009421af2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:54.626598 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d472876-b259-45bc-b605-4fd009421af2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:54.627058 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d472876-b259-45bc-b605-4fd009421af2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:54.627766 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d472876-b259-45bc-b605-4fd009421af2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:54.628222 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d472876-b259-45bc-b605-4fd009421af2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:54.628644 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d472876-b259-45bc-b605-4fd009421af2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:54.647735 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=100 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:01:54.704439 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-3a1e0907-fb88-4c72-94e9-2c1d2e7e56d6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:54.705765 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-3a1e0907-fb88-4c72-94e9-2c1d2e7e56d6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:54.712116 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3a1e0907-fb88-4c72-94e9-2c1d2e7e56d6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:54.712824 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3a1e0907-fb88-4c72-94e9-2c1d2e7e56d6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:54.713251 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3a1e0907-fb88-4c72-94e9-2c1d2e7e56d6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:54.714107 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3a1e0907-fb88-4c72-94e9-2c1d2e7e56d6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:54.714561 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3a1e0907-fb88-4c72-94e9-2c1d2e7e56d6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:54.715020 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3a1e0907-fb88-4c72-94e9-2c1d2e7e56d6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:54.735400 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=100 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:01:54.919832 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-5d472876-b259-45bc-b605-4fd009421af2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:54.938365 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-5d472876-b259-45bc-b605-4fd009421af2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1260 microversion: 2.1 time: 0.322964 Aug 26 16:01:54.939968 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 385/789] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:54 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1260 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:54.963919 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-3a1e0907-fb88-4c72-94e9-2c1d2e7e56d6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:54.973873 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-3a1e0907-fb88-4c72-94e9-2c1d2e7e56d6 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1366 microversion: 2.1 time: 0.273891 Aug 26 16:01:54.974561 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 405/790] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:54 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:01:55.106885 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ce889696-2c86-41e8-9123-41f829fe8d39 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:55.107542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ce889696-2c86-41e8-9123-41f829fe8d39 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:55.113969 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ce889696-2c86-41e8-9123-41f829fe8d39 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:55.114517 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ce889696-2c86-41e8-9123-41f829fe8d39 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:55.114984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ce889696-2c86-41e8-9123-41f829fe8d39 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:55.115684 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ce889696-2c86-41e8-9123-41f829fe8d39 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:55.116137 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ce889696-2c86-41e8-9123-41f829fe8d39 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:55.116566 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ce889696-2c86-41e8-9123-41f829fe8d39 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:55.199697 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-ce889696-2c86-41e8-9123-41f829fe8d39 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:55.210390 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ce889696-2c86-41e8-9123-41f829fe8d39 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1317 microversion: 2.1 time: 0.107379 Aug 26 16:01:55.224265 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 386/791] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:55 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1317 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:55.582066 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-cf659d87-927f-426a-bb72-488e668d48f6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:55.583101 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-cf659d87-927f-426a-bb72-488e668d48f6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:55.589325 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:01:55.591934 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cf659d87-927f-426a-bb72-488e668d48f6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:55.591934 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cf659d87-927f-426a-bb72-488e668d48f6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:55.592519 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cf659d87-927f-426a-bb72-488e668d48f6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:55.593740 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cf659d87-927f-426a-bb72-488e668d48f6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:55.594353 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cf659d87-927f-426a-bb72-488e668d48f6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:55.595166 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cf659d87-927f-426a-bb72-488e668d48f6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:55.614994 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.wsgi [None req-cf659d87-927f-426a-bb72-488e668d48f6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] HTTP exception thrown: Instance 8ac977a7-aa08-459a-a863-36ba667422d1 could not be found. Aug 26 16:01:55.615794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-cf659d87-927f-426a-bb72-488e668d48f6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Request method failure captured: Aug 26 16:01:55.615794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: request: GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 HTTP/1.1 Aug 26 16:01:55.615794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept: application/json Aug 26 16:01:55.615794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept-Encoding: identity Aug 26 16:01:55.615794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Connection: close Aug 26 16:01:55.615794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Length: 0 Aug 26 16:01:55.615794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Type: application/json Aug 26 16:01:55.615794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Host: 10.222.0.94 Aug 26 16:01:55.615794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Openstack-System-Scope: None Aug 26 16:01:55.615794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: User-Agent: python-urllib3/1.26.11 Aug 26 16:01:55.615794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Auth-Token: gAAAAABjCO1F1UfIrbIIIqx800DhgBQ_xLKUPQNDExaayaNWSrORPZqmlaNEr9-HCq5faaWsVbGXZxapKHPq-pZ9plOFRfzz3LDwvmt0IPrL8R0nR1c0gI7mXph447z8r464fSPa-J2FQWiNavpaQfTuChWNsILpXatKerRG5u9XFwxbJRh2x3U Aug 26 16:01:55.615794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Id: None Aug 26 16:01:55.615794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Name: None Aug 26 16:01:55.615794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Identity-Status: Confirmed Aug 26 16:01:55.615794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Is-Admin-Project: True Aug 26 16:01:55.615794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 16:01:55.615794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Id: default Aug 26 16:01:55.615794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Name: Default Aug 26 16:01:55.615794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Id: e8bfb4199b0d4a57933fe1b685aa01cd Aug 26 16:01:55.615794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-752766866 Aug 26 16:01:55.615794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Role: member,reader Aug 26 16:01:55.615794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Roles: member,reader Aug 26 16:01:55.617448 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/e8bfb4199b0d4a57933fe1b685aa01cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/e8bfb4199b0d4a57933fe1b685aa01cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/e8bfb4199b0d4a57933fe1b685aa01cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_e8bfb4199b0d4a57933fe1b685aa01cd", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:01:55.617448 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant: tempest-AttachVolumeShelveTestJSON-752766866 Aug 26 16:01:55.617448 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Id: e8bfb4199b0d4a57933fe1b685aa01cd Aug 26 16:01:55.617448 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-752766866 Aug 26 16:01:55.617448 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User: tempest-AttachVolumeShelveTestJSON-752766866-project Aug 26 16:01:55.617448 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Id: default Aug 26 16:01:55.617448 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Name: Default Aug 26 16:01:55.617448 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Id: 228837054cd648acb0df93dd423e1d83 Aug 26 16:01:55.617448 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Name: tempest-AttachVolumeShelveTestJSON-752766866-project Aug 26 16:01:55.617448 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: method: > Aug 26 16:01:55.617448 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: exception: Instance 8ac977a7-aa08-459a-a863-36ba667422d1 could not be found. Aug 26 16:01:55.617448 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: action_args: {'id': '8ac977a7-aa08-459a-a863-36ba667422d1'} Aug 26 16:01:55.618305 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:01:55.618305 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:55.618305 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:01:55.618305 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:01:55.618305 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:01:55.618305 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:01:55.618305 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:01:55.618305 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:01:55.618305 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:01:55.618305 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:01:55.618305 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ac977a7-aa08-459a-a863-36ba667422d1 could not be found. Aug 26 16:01:55.618305 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:01:55.618305 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:01:55.618305 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:01:55.618305 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:55.618305 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:01:55.618305 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:01:55.618305 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:01:55.618305 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:01:55.618305 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:01:55.619729 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:01:55.619729 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:01:55.619729 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:01:55.619729 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:01:55.619729 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:01:55.619729 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:01:55.619729 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:01:55.619729 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ac977a7-aa08-459a-a863-36ba667422d1 could not be found. Aug 26 16:01:55.619729 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:01:55.619729 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:01:55.619729 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:01:55.619729 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:01:55.619729 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:01:55.619729 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:01:55.619729 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:01:55.619729 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:01:55.619729 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ac977a7-aa08-459a-a863-36ba667422d1 could not be found. Aug 26 16:01:55.619729 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:01:55.621993 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-cf659d87-927f-426a-bb72-488e668d48f6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Returning 404 to user: Instance 8ac977a7-aa08-459a-a863-36ba667422d1 could not be found. {{(pid=128305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:01:55.624215 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-cf659d87-927f-426a-bb72-488e668d48f6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 404 len: 111 microversion: 2.20 time: 0.046552 Aug 26 16:01:55.624791 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 406/792] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:01:55 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 16:01:55.634811 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-32723c65-4bcc-4aaa-9efe-04746b2f1492 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '.version_select at 0x7f15d9449a60>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:55.755876 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-32723c65-4bcc-4aaa-9efe-04746b2f1492 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1446175540" status: 204 len: 0 microversion: 2.20 time: 0.124527 Aug 26 16:01:55.756953 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 387/793] 10.222.0.94 () {60 vars in 1262 bytes} [Fri Aug 26 16:01:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1446175540 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 26 16:01:55.972969 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-74a89e93-c077-4a28-a150-53adebb9cd13 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:55.974054 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-74a89e93-c077-4a28-a150-53adebb9cd13 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:55.989646 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-74a89e93-c077-4a28-a150-53adebb9cd13 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:55.990215 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-74a89e93-c077-4a28-a150-53adebb9cd13 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:55.996902 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f60ab284-0547-4162-9b4d-db587c88d8b5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:55.998697 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-f60ab284-0547-4162-9b4d-db587c88d8b5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:56.003786 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-74a89e93-c077-4a28-a150-53adebb9cd13 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:56.005097 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-74a89e93-c077-4a28-a150-53adebb9cd13 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:56.011164 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-74a89e93-c077-4a28-a150-53adebb9cd13 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:56.011164 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-74a89e93-c077-4a28-a150-53adebb9cd13 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:56.018107 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f60ab284-0547-4162-9b4d-db587c88d8b5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:56.018615 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f60ab284-0547-4162-9b4d-db587c88d8b5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:56.019761 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f60ab284-0547-4162-9b4d-db587c88d8b5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:56.020483 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f60ab284-0547-4162-9b4d-db587c88d8b5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:56.020942 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f60ab284-0547-4162-9b4d-db587c88d8b5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:56.023847 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f60ab284-0547-4162-9b4d-db587c88d8b5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:56.355230 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-f60ab284-0547-4162-9b4d-db587c88d8b5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:56.365673 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-74a89e93-c077-4a28-a150-53adebb9cd13 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:56.372871 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-f60ab284-0547-4162-9b4d-db587c88d8b5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1366 microversion: 2.1 time: 0.380440 Aug 26 16:01:56.374619 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 388/794] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:55 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1366 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:01:56.378636 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-74a89e93-c077-4a28-a150-53adebb9cd13 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1260 microversion: 2.1 time: 0.410195 Aug 26 16:01:56.380352 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-51031d9b-a5e0-459d-92fa-ab8e58523a1f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:56.381170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-51031d9b-a5e0-459d-92fa-ab8e58523a1f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:56.388786 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 407/795] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:55 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1260 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:56.392337 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-51031d9b-a5e0-459d-92fa-ab8e58523a1f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:56.393167 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-51031d9b-a5e0-459d-92fa-ab8e58523a1f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:56.393773 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-51031d9b-a5e0-459d-92fa-ab8e58523a1f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:56.394546 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-51031d9b-a5e0-459d-92fa-ab8e58523a1f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:56.395048 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-51031d9b-a5e0-459d-92fa-ab8e58523a1f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:56.398287 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-51031d9b-a5e0-459d-92fa-ab8e58523a1f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:56.591521 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-51031d9b-a5e0-459d-92fa-ab8e58523a1f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:56.601158 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-51031d9b-a5e0-459d-92fa-ab8e58523a1f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1359 microversion: 2.1 time: 0.225103 Aug 26 16:01:56.607887 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 389/796] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:56 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:57.094484 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-66e2346b-6959-451d-90f6-d53faea7e6a7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Action: 'create', calling method: .version_select at 0x7f15d99da310>, body: {"keypair": {"name": "tempest-keypair-1678684181", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFAp5KexFGZ8Gk05FWzEukyQIAxZk32OIaI6EocvqRBCBXfge5KNmOyYEcWbpucTAtbdobQ6ebZm43u8GQLjHOvioDWxDoG1/vNDjmm3+aVlbJ+/G6ch9Mi6pG4aZeRTA=="}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:01:57.110775 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-66e2346b-6959-451d-90f6-d53faea7e6a7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Getting quotas for project e8bfb4199b0d4a57933fe1b685aa01cd. Resources: {'key_pairs'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 16:01:57.114983 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-66e2346b-6959-451d-90f6-d53faea7e6a7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Getting quotas for user 228837054cd648acb0df93dd423e1d83 and project e8bfb4199b0d4a57933fe1b685aa01cd. Resources: {'key_pairs'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 16:01:57.220641 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-66e2346b-6959-451d-90f6-d53faea7e6a7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.130965 Aug 26 16:01:57.221929 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 408/797] 10.222.0.94 () {62 vars in 1200 bytes} [Fri Aug 26 16:01:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 133 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 26 16:01:57.404991 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-55673fb9-ebbd-4c1e-8677-6a43b2a7f05b tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:57.405217 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-80583cbc-82bd-4464-a7ec-4a68b82e43dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:57.407435 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-80583cbc-82bd-4464-a7ec-4a68b82e43dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:57.408667 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-55673fb9-ebbd-4c1e-8677-6a43b2a7f05b tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:57.431173 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-80583cbc-82bd-4464-a7ec-4a68b82e43dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:57.431744 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-55673fb9-ebbd-4c1e-8677-6a43b2a7f05b tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:57.432372 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-80583cbc-82bd-4464-a7ec-4a68b82e43dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:57.432671 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-55673fb9-ebbd-4c1e-8677-6a43b2a7f05b tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:57.433520 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-80583cbc-82bd-4464-a7ec-4a68b82e43dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:57.434066 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-55673fb9-ebbd-4c1e-8677-6a43b2a7f05b tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:57.435807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-80583cbc-82bd-4464-a7ec-4a68b82e43dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:57.436632 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-80583cbc-82bd-4464-a7ec-4a68b82e43dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:57.436930 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-55673fb9-ebbd-4c1e-8677-6a43b2a7f05b tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:57.437579 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-80583cbc-82bd-4464-a7ec-4a68b82e43dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:57.437957 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-55673fb9-ebbd-4c1e-8677-6a43b2a7f05b tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:57.440011 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-55673fb9-ebbd-4c1e-8677-6a43b2a7f05b tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:57.798337 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-55673fb9-ebbd-4c1e-8677-6a43b2a7f05b tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:57.808022 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-80583cbc-82bd-4464-a7ec-4a68b82e43dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:57.810460 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-55673fb9-ebbd-4c1e-8677-6a43b2a7f05b tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1260 microversion: 2.1 time: 0.414304 Aug 26 16:01:57.812550 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 409/798] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:57 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1260 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:57.820417 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-52b58980-ba3f-4269-8d70-606e872b5c75 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:57.821525 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-52b58980-ba3f-4269-8d70-606e872b5c75 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:57.829452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-52b58980-ba3f-4269-8d70-606e872b5c75 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:57.829939 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-52b58980-ba3f-4269-8d70-606e872b5c75 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:57.830763 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-52b58980-ba3f-4269-8d70-606e872b5c75 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:57.831215 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-80583cbc-82bd-4464-a7ec-4a68b82e43dc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1366 microversion: 2.1 time: 0.439826 Aug 26 16:01:57.832014 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-52b58980-ba3f-4269-8d70-606e872b5c75 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:57.832131 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 390/799] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:57 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1366 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:57.832901 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-52b58980-ba3f-4269-8d70-606e872b5c75 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:57.833325 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-52b58980-ba3f-4269-8d70-606e872b5c75 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:58.014170 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-52b58980-ba3f-4269-8d70-606e872b5c75 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:58.019649 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-52b58980-ba3f-4269-8d70-606e872b5c75 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1359 microversion: 2.1 time: 0.204479 Aug 26 16:01:58.026064 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 410/800] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:57 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:58.831054 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-24db6938-7d9c-4393-9183-82809427a832 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:58.832414 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-24db6938-7d9c-4393-9183-82809427a832 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:58.834630 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell0:SELECT=2 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:01:58.840415 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-24db6938-7d9c-4393-9183-82809427a832 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:58.849208 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-24db6938-7d9c-4393-9183-82809427a832 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:58.849208 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-24db6938-7d9c-4393-9183-82809427a832 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:58.849208 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-24db6938-7d9c-4393-9183-82809427a832 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:58.849208 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-24db6938-7d9c-4393-9183-82809427a832 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:58.849568 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-24db6938-7d9c-4393-9183-82809427a832 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:58.858897 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-0d310c78-bda8-4761-939e-9271a20efadf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:58.859611 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-0d310c78-bda8-4761-939e-9271a20efadf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:58.871102 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0d310c78-bda8-4761-939e-9271a20efadf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:58.871885 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0d310c78-bda8-4761-939e-9271a20efadf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:58.872730 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0d310c78-bda8-4761-939e-9271a20efadf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:58.873717 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0d310c78-bda8-4761-939e-9271a20efadf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:58.874331 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0d310c78-bda8-4761-939e-9271a20efadf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:58.874948 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0d310c78-bda8-4761-939e-9271a20efadf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:59.162064 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-24db6938-7d9c-4393-9183-82809427a832 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:59.180662 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-24db6938-7d9c-4393-9183-82809427a832 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1260 microversion: 2.1 time: 0.353680 Aug 26 16:01:59.191114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 391/801] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:58 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1260 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:59.193861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-0d310c78-bda8-4761-939e-9271a20efadf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:59.195431 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-b5641e91-ca79-461b-84db-a111b210964d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:01:59.197818 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-b5641e91-ca79-461b-84db-a111b210964d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:01:59.207465 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-0d310c78-bda8-4761-939e-9271a20efadf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1366 microversion: 2.1 time: 0.353496 Aug 26 16:01:59.209424 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 411/802] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:58 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1366 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:01:59.213994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b5641e91-ca79-461b-84db-a111b210964d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:59.214713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b5641e91-ca79-461b-84db-a111b210964d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:59.215393 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b5641e91-ca79-461b-84db-a111b210964d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:59.217109 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b5641e91-ca79-461b-84db-a111b210964d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:59.217772 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b5641e91-ca79-461b-84db-a111b210964d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:59.218413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b5641e91-ca79-461b-84db-a111b210964d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:59.374808 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell0:SELECT=12 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:01:59.452305 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-b5641e91-ca79-461b-84db-a111b210964d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:01:59.463785 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-b5641e91-ca79-461b-84db-a111b210964d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1359 microversion: 2.1 time: 0.281344 Aug 26 16:01:59.465115 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 392/803] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:01:59 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1359 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:01:59.610053 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-5955fd5f-2e4f-485c-9e2e-50e40b570da2 req-26ccdc6b-0711-48b5-9741-aa40ea15118b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f241a343-9b6e-471f-9a18-964d506fe4f3", "name": "network-vif-plugged", "status": "completed", "tag": "726f3f44-7d5b-426a-98ae-f35cdf9b45b9"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:01:59.624008 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-5955fd5f-2e4f-485c-9e2e-50e40b570da2 req-26ccdc6b-0711-48b5-9741-aa40ea15118b service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:01:59.624760 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-5955fd5f-2e4f-485c-9e2e-50e40b570da2 req-26ccdc6b-0711-48b5-9741-aa40ea15118b service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:01:59.625350 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-5955fd5f-2e4f-485c-9e2e-50e40b570da2 req-26ccdc6b-0711-48b5-9741-aa40ea15118b service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:01:59.640639 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-5955fd5f-2e4f-485c-9e2e-50e40b570da2 req-26ccdc6b-0711-48b5-9741-aa40ea15118b service nova] Creating event network-vif-plugged:726f3f44-7d5b-426a-98ae-f35cdf9b45b9 for instance f241a343-9b6e-471f-9a18-964d506fe4f3 on hv-cinder-85144 Aug 26 16:01:59.647336 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-5955fd5f-2e4f-485c-9e2e-50e40b570da2 req-26ccdc6b-0711-48b5-9741-aa40ea15118b service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043114 Aug 26 16:01:59.653328 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 412/804] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:02:00.205109 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-842b594f-aa17-496d-a11f-ef7a628ddbad tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:00.205674 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-842b594f-aa17-496d-a11f-ef7a628ddbad tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:00.212553 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-842b594f-aa17-496d-a11f-ef7a628ddbad tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:00.213029 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-842b594f-aa17-496d-a11f-ef7a628ddbad tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:00.213463 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-842b594f-aa17-496d-a11f-ef7a628ddbad tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:00.214214 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-842b594f-aa17-496d-a11f-ef7a628ddbad tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:00.214861 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-842b594f-aa17-496d-a11f-ef7a628ddbad tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:00.215355 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-842b594f-aa17-496d-a11f-ef7a628ddbad tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:00.243012 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-cccb480f-3893-40ca-87ad-0e65b1723713 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:00.243721 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-cccb480f-3893-40ca-87ad-0e65b1723713 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:00.250842 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cccb480f-3893-40ca-87ad-0e65b1723713 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:00.251356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cccb480f-3893-40ca-87ad-0e65b1723713 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:00.251789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cccb480f-3893-40ca-87ad-0e65b1723713 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:00.252490 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cccb480f-3893-40ca-87ad-0e65b1723713 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:00.252935 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cccb480f-3893-40ca-87ad-0e65b1723713 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:00.253570 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cccb480f-3893-40ca-87ad-0e65b1723713 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:00.477584 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-842b594f-aa17-496d-a11f-ef7a628ddbad tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:00.487140 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-842b594f-aa17-496d-a11f-ef7a628ddbad tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1260 microversion: 2.1 time: 0.287471 Aug 26 16:02:00.487827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 393/805] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:00 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1260 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:00.492512 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-db1efe5f-d4e2-47db-82a9-4790339104d3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:00.499725 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-db1efe5f-d4e2-47db-82a9-4790339104d3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:00.506677 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-db1efe5f-d4e2-47db-82a9-4790339104d3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:00.506677 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-db1efe5f-d4e2-47db-82a9-4790339104d3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:00.508291 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-db1efe5f-d4e2-47db-82a9-4790339104d3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:00.509314 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-db1efe5f-d4e2-47db-82a9-4790339104d3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:00.509943 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-db1efe5f-d4e2-47db-82a9-4790339104d3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:00.510550 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-db1efe5f-d4e2-47db-82a9-4790339104d3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:00.511248 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-cccb480f-3893-40ca-87ad-0e65b1723713 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:00.521010 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-cccb480f-3893-40ca-87ad-0e65b1723713 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1366 microversion: 2.1 time: 0.294847 Aug 26 16:02:00.522102 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 413/806] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:00 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:02:00.565264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-227c27b8-f588-43a9-ab25-931ebde56a00 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1269602343", "imageRef": "bcbdbb0c-7335-4427-a636-e2dc730274b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "14fbb9b0-48c1-40b4-822d-b21197d95a3b"}], "security_groups": [{"name": "tempest-securitygroup--1780594376"}], "key_name": "tempest-keypair-1678684181", "user_data": "}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:00.757668 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-db1efe5f-d4e2-47db-82a9-4790339104d3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:00.760127 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.network.neutron [None req-227c27b8-f588-43a9-ab25-931ebde56a00 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] validate_networks() for [('14fbb9b0-48c1-40b4-822d-b21197d95a3b', None, None, None, None, None)] {{(pid=128305) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 16:02:00.767959 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-db1efe5f-d4e2-47db-82a9-4790339104d3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1359 microversion: 2.1 time: 0.278928 Aug 26 16:02:00.769182 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 394/807] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:00 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1359 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:01.457182 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-227c27b8-f588-43a9-ab25-931ebde56a00 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Flavor limits 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 16:02:01.457702 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-227c27b8-f588-43a9-ab25-931ebde56a00 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Image limits 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 16:02:01.458062 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-227c27b8-f588-43a9-ab25-931ebde56a00 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Flavor pref 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 16:02:01.458493 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-227c27b8-f588-43a9-ab25-931ebde56a00 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Image pref 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 16:02:01.458904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-227c27b8-f588-43a9-ab25-931ebde56a00 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 16:02:01.467920 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-227c27b8-f588-43a9-ab25-931ebde56a00 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:01.468480 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-227c27b8-f588-43a9-ab25-931ebde56a00 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:01.468892 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-227c27b8-f588-43a9-ab25-931ebde56a00 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:01.469628 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-227c27b8-f588-43a9-ab25-931ebde56a00 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:01.470105 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-227c27b8-f588-43a9-ab25-931ebde56a00 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:01.470529 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-227c27b8-f588-43a9-ab25-931ebde56a00 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:01.487512 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-227c27b8-f588-43a9-ab25-931ebde56a00 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Getting quotas for project e8bfb4199b0d4a57933fe1b685aa01cd. Resources: {'instances', 'ram', 'cores'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 16:02:01.492272 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-227c27b8-f588-43a9-ab25-931ebde56a00 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Getting quotas for user 228837054cd648acb0df93dd423e1d83 and project e8bfb4199b0d4a57933fe1b685aa01cd. Resources: {'instances', 'ram', 'cores'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 16:02:01.507663 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-227c27b8-f588-43a9-ab25-931ebde56a00 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Going to run 1 instances... {{(pid=128305) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 16:02:01.510860 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-227c27b8-f588-43a9-ab25-931ebde56a00 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bcbdbb0c-7335-4427-a636-e2dc730274b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128305) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 16:02:01.511370 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-50ee9645-39d6-49d2-8335-4009f98b7beb tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:01.512548 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-50ee9645-39d6-49d2-8335-4009f98b7beb tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:01.520994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-50ee9645-39d6-49d2-8335-4009f98b7beb tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:01.524322 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-50ee9645-39d6-49d2-8335-4009f98b7beb tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:01.524322 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-50ee9645-39d6-49d2-8335-4009f98b7beb tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:01.524322 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-50ee9645-39d6-49d2-8335-4009f98b7beb tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:01.524322 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-50ee9645-39d6-49d2-8335-4009f98b7beb tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:01.524899 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-50ee9645-39d6-49d2-8335-4009f98b7beb tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:01.679719 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-227c27b8-f588-43a9-ab25-931ebde56a00 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.119925 Aug 26 16:02:01.680600 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 414/808] 10.222.0.94 () {62 vars in 1188 bytes} [Fri Aug 26 16:02:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 1122 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 26 16:02:01.686206 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-5989daa0-f69c-4347-aeb4-03a3abf33903 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:01.687055 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-5989daa0-f69c-4347-aeb4-03a3abf33903 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:01.703559 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5989daa0-f69c-4347-aeb4-03a3abf33903 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:01.704641 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5989daa0-f69c-4347-aeb4-03a3abf33903 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:01.705525 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5989daa0-f69c-4347-aeb4-03a3abf33903 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:01.706563 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5989daa0-f69c-4347-aeb4-03a3abf33903 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:01.707266 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5989daa0-f69c-4347-aeb4-03a3abf33903 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:01.707984 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5989daa0-f69c-4347-aeb4-03a3abf33903 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:01.773007 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-50ee9645-39d6-49d2-8335-4009f98b7beb tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:01.782243 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-50ee9645-39d6-49d2-8335-4009f98b7beb tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1260 microversion: 2.1 time: 0.276272 Aug 26 16:02:01.796839 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 395/809] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:01 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1260 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:01.802062 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-acb21d26-13e4-4405-91cc-ee4789f56649 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:01.802977 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-acb21d26-13e4-4405-91cc-ee4789f56649 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:01.925949 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-acb21d26-13e4-4405-91cc-ee4789f56649 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:01.938153 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-acb21d26-13e4-4405-91cc-ee4789f56649 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:01.939824 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-acb21d26-13e4-4405-91cc-ee4789f56649 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:01.941135 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-acb21d26-13e4-4405-91cc-ee4789f56649 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1282 microversion: 2.20 time: 0.142979 Aug 26 16:02:01.941691 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 396/810] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:02:01 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1282 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:02:01.948207 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7b18dcd0-879a-459c-85bd-c406b2538f52 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:01.955244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-7b18dcd0-879a-459c-85bd-c406b2538f52 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:01.962306 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7b18dcd0-879a-459c-85bd-c406b2538f52 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:01.962508 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7b18dcd0-879a-459c-85bd-c406b2538f52 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:01.962987 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7b18dcd0-879a-459c-85bd-c406b2538f52 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:01.963689 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7b18dcd0-879a-459c-85bd-c406b2538f52 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:01.964136 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7b18dcd0-879a-459c-85bd-c406b2538f52 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:01.964560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7b18dcd0-879a-459c-85bd-c406b2538f52 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:02.108716 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-5989daa0-f69c-4347-aeb4-03a3abf33903 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:02.108716 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-5989daa0-f69c-4347-aeb4-03a3abf33903 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1366 microversion: 2.1 time: 0.323959 Aug 26 16:02:02.108716 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 415/811] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:01 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:02.162476 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7b18dcd0-879a-459c-85bd-c406b2538f52 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:02.172363 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-7b18dcd0-879a-459c-85bd-c406b2538f52 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1359 microversion: 2.1 time: 0.228107 Aug 26 16:02:02.172948 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 397/812] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:01 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1359 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:02.803440 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-df1f8b88-f5b1-48b6-979b-01065ce96433 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:02.804088 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-df1f8b88-f5b1-48b6-979b-01065ce96433 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:02.811742 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-df1f8b88-f5b1-48b6-979b-01065ce96433 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:02.812502 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-df1f8b88-f5b1-48b6-979b-01065ce96433 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:02.812937 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-df1f8b88-f5b1-48b6-979b-01065ce96433 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:02.813815 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-df1f8b88-f5b1-48b6-979b-01065ce96433 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:02.814427 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-df1f8b88-f5b1-48b6-979b-01065ce96433 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:02.815042 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-df1f8b88-f5b1-48b6-979b-01065ce96433 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:02.964759 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-2d5131ae-a122-4633-b678-6f482bb261de tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:02.965614 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-2d5131ae-a122-4633-b678-6f482bb261de tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:03.045856 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-2d5131ae-a122-4633-b678-6f482bb261de tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:03.051030 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-df1f8b88-f5b1-48b6-979b-01065ce96433 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:03.053739 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-2d5131ae-a122-4633-b678-6f482bb261de tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:03.055218 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-2d5131ae-a122-4633-b678-6f482bb261de tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:03.056335 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-2d5131ae-a122-4633-b678-6f482bb261de tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1282 microversion: 2.20 time: 0.095567 Aug 26 16:02:03.056902 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 398/813] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:02:02 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1282 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:02:03.058601 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-df1f8b88-f5b1-48b6-979b-01065ce96433 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1260 microversion: 2.1 time: 0.259066 Aug 26 16:02:03.059188 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 416/814] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:02 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1260 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:03.114463 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-b7272422-fc4c-46bf-b44d-6fd9c5e7a9ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:03.115370 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-b7272422-fc4c-46bf-b44d-6fd9c5e7a9ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:03.123844 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b7272422-fc4c-46bf-b44d-6fd9c5e7a9ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:03.136503 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b7272422-fc4c-46bf-b44d-6fd9c5e7a9ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:03.136503 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b7272422-fc4c-46bf-b44d-6fd9c5e7a9ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:03.136503 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b7272422-fc4c-46bf-b44d-6fd9c5e7a9ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:03.136503 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b7272422-fc4c-46bf-b44d-6fd9c5e7a9ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:03.136904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b7272422-fc4c-46bf-b44d-6fd9c5e7a9ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:03.193521 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-00ca8519-b674-4250-abdb-edde94d0a4d9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:03.194188 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-00ca8519-b674-4250-abdb-edde94d0a4d9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:03.224074 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-00ca8519-b674-4250-abdb-edde94d0a4d9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:03.224661 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-00ca8519-b674-4250-abdb-edde94d0a4d9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:03.225105 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-00ca8519-b674-4250-abdb-edde94d0a4d9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:03.225849 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-00ca8519-b674-4250-abdb-edde94d0a4d9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:03.226309 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-00ca8519-b674-4250-abdb-edde94d0a4d9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:03.226726 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-00ca8519-b674-4250-abdb-edde94d0a4d9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:03.293099 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-b7272422-fc4c-46bf-b44d-6fd9c5e7a9ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:03.302906 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-b7272422-fc4c-46bf-b44d-6fd9c5e7a9ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1366 microversion: 2.1 time: 0.192518 Aug 26 16:02:03.316674 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 399/815] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:03 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:03.429477 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-00ca8519-b674-4250-abdb-edde94d0a4d9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:03.439505 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-00ca8519-b674-4250-abdb-edde94d0a4d9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1359 microversion: 2.1 time: 0.249664 Aug 26 16:02:03.444379 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 417/816] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:03 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1359 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:04.080084 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-1c78a29c-2a7b-44e4-bf0a-635889b15d72 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:04.080836 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-12191f1e-90f6-4254-9e19-4536ada1db0c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:04.081252 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-1c78a29c-2a7b-44e4-bf0a-635889b15d72 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:04.081617 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-12191f1e-90f6-4254-9e19-4536ada1db0c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:04.088388 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-12191f1e-90f6-4254-9e19-4536ada1db0c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:04.088872 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-12191f1e-90f6-4254-9e19-4536ada1db0c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:04.089307 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-12191f1e-90f6-4254-9e19-4536ada1db0c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:04.090009 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-12191f1e-90f6-4254-9e19-4536ada1db0c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:04.091318 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-12191f1e-90f6-4254-9e19-4536ada1db0c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:04.091750 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-12191f1e-90f6-4254-9e19-4536ada1db0c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:04.092326 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1c78a29c-2a7b-44e4-bf0a-635889b15d72 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:04.092825 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1c78a29c-2a7b-44e4-bf0a-635889b15d72 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:04.093268 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1c78a29c-2a7b-44e4-bf0a-635889b15d72 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:04.094122 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1c78a29c-2a7b-44e4-bf0a-635889b15d72 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:04.094756 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1c78a29c-2a7b-44e4-bf0a-635889b15d72 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:04.095383 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1c78a29c-2a7b-44e4-bf0a-635889b15d72 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:04.191429 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-12191f1e-90f6-4254-9e19-4536ada1db0c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:04.200429 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-12191f1e-90f6-4254-9e19-4536ada1db0c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:04.202271 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-12191f1e-90f6-4254-9e19-4536ada1db0c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:04.203627 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-12191f1e-90f6-4254-9e19-4536ada1db0c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1286 microversion: 2.20 time: 0.127065 Aug 26 16:02:04.204361 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 418/817] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:02:04 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1286 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:02:04.266275 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-1c78a29c-2a7b-44e4-bf0a-635889b15d72 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:04.274398 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-1c78a29c-2a7b-44e4-bf0a-635889b15d72 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1260 microversion: 2.1 time: 0.198254 Aug 26 16:02:04.275005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 400/818] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:04 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1260 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:04.324766 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-b7588a44-e268-4f6c-a7f1-1b2f73cf1bc7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:04.325595 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-b7588a44-e268-4f6c-a7f1-1b2f73cf1bc7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:04.331955 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b7588a44-e268-4f6c-a7f1-1b2f73cf1bc7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:04.332443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b7588a44-e268-4f6c-a7f1-1b2f73cf1bc7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:04.332958 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b7588a44-e268-4f6c-a7f1-1b2f73cf1bc7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:04.333730 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b7588a44-e268-4f6c-a7f1-1b2f73cf1bc7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:04.334238 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b7588a44-e268-4f6c-a7f1-1b2f73cf1bc7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:04.334721 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b7588a44-e268-4f6c-a7f1-1b2f73cf1bc7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:04.467340 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-34647e72-9a8c-4d2b-872a-4685a22fedd0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:04.467960 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-34647e72-9a8c-4d2b-872a-4685a22fedd0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:04.476706 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b7588a44-e268-4f6c-a7f1-1b2f73cf1bc7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:04.480423 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-34647e72-9a8c-4d2b-872a-4685a22fedd0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:04.483736 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-34647e72-9a8c-4d2b-872a-4685a22fedd0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:04.484409 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-34647e72-9a8c-4d2b-872a-4685a22fedd0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:04.485540 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-34647e72-9a8c-4d2b-872a-4685a22fedd0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:04.486398 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-34647e72-9a8c-4d2b-872a-4685a22fedd0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:04.487195 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-34647e72-9a8c-4d2b-872a-4685a22fedd0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:04.489864 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-b7588a44-e268-4f6c-a7f1-1b2f73cf1bc7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1366 microversion: 2.1 time: 0.169270 Aug 26 16:02:04.491162 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 419/819] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:04 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:04.628028 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-34647e72-9a8c-4d2b-872a-4685a22fedd0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:04.635702 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-34647e72-9a8c-4d2b-872a-4685a22fedd0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1359 microversion: 2.1 time: 0.173069 Aug 26 16:02:04.636268 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 401/820] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:04 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:02:05.227570 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-4ab563a1-b725-4c8d-b9ae-22a5f1d67841 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:05.228170 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-4ab563a1-b725-4c8d-b9ae-22a5f1d67841 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:05.235423 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4ab563a1-b725-4c8d-b9ae-22a5f1d67841 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:05.235899 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4ab563a1-b725-4c8d-b9ae-22a5f1d67841 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:05.236329 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4ab563a1-b725-4c8d-b9ae-22a5f1d67841 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:05.237009 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4ab563a1-b725-4c8d-b9ae-22a5f1d67841 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:05.237450 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4ab563a1-b725-4c8d-b9ae-22a5f1d67841 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:05.237864 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4ab563a1-b725-4c8d-b9ae-22a5f1d67841 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:05.297042 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-0f3e42d4-7726-4cde-a65c-09ddfa1e2cec tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:05.297636 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-0f3e42d4-7726-4cde-a65c-09ddfa1e2cec tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:05.298837 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-4ab563a1-b725-4c8d-b9ae-22a5f1d67841 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:05.304673 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f3e42d4-7726-4cde-a65c-09ddfa1e2cec tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:05.305277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f3e42d4-7726-4cde-a65c-09ddfa1e2cec tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:05.305784 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f3e42d4-7726-4cde-a65c-09ddfa1e2cec tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:05.306561 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f3e42d4-7726-4cde-a65c-09ddfa1e2cec tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:05.306986 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-4ab563a1-b725-4c8d-b9ae-22a5f1d67841 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:05.307206 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f3e42d4-7726-4cde-a65c-09ddfa1e2cec tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:05.307702 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0f3e42d4-7726-4cde-a65c-09ddfa1e2cec tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:05.308418 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-4ab563a1-b725-4c8d-b9ae-22a5f1d67841 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:05.310405 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-4ab563a1-b725-4c8d-b9ae-22a5f1d67841 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1286 microversion: 2.20 time: 0.086565 Aug 26 16:02:05.311077 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 420/821] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:02:05 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:02:05.511291 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-8e5fe55b-acf5-4de2-9edf-66370aceba2b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:05.514008 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-8e5fe55b-acf5-4de2-9edf-66370aceba2b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:05.520455 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8e5fe55b-acf5-4de2-9edf-66370aceba2b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:05.520940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8e5fe55b-acf5-4de2-9edf-66370aceba2b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:05.521400 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8e5fe55b-acf5-4de2-9edf-66370aceba2b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:05.522117 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8e5fe55b-acf5-4de2-9edf-66370aceba2b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:05.522596 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8e5fe55b-acf5-4de2-9edf-66370aceba2b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:05.523050 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8e5fe55b-acf5-4de2-9edf-66370aceba2b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:05.753340 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-0f3e42d4-7726-4cde-a65c-09ddfa1e2cec tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:05.763332 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-0f3e42d4-7726-4cde-a65c-09ddfa1e2cec tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1260 microversion: 2.1 time: 0.470341 Aug 26 16:02:05.764059 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 402/822] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:05 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1260 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:02:05.768789 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-586e505f-36b8-4db4-84ca-a9d00c1e14c8 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:05.773253 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-586e505f-36b8-4db4-84ca-a9d00c1e14c8 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:05.776398 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-586e505f-36b8-4db4-84ca-a9d00c1e14c8 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:05.776872 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-586e505f-36b8-4db4-84ca-a9d00c1e14c8 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:05.777298 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-586e505f-36b8-4db4-84ca-a9d00c1e14c8 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:05.777991 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-586e505f-36b8-4db4-84ca-a9d00c1e14c8 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:05.779156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-586e505f-36b8-4db4-84ca-a9d00c1e14c8 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:05.779580 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-586e505f-36b8-4db4-84ca-a9d00c1e14c8 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:05.803625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-8e5fe55b-acf5-4de2-9edf-66370aceba2b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:05.818461 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-8e5fe55b-acf5-4de2-9edf-66370aceba2b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1366 microversion: 2.1 time: 0.311325 Aug 26 16:02:05.825234 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 421/823] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:05 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:02:05.922781 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-586e505f-36b8-4db4-84ca-a9d00c1e14c8 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:05.930863 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-586e505f-36b8-4db4-84ca-a9d00c1e14c8 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1359 microversion: 2.1 time: 0.165644 Aug 26 16:02:05.931480 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 403/824] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:05 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:06.332442 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a319b0eb-6397-474c-9d0e-ad8f35e954e5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:06.333083 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a319b0eb-6397-474c-9d0e-ad8f35e954e5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:06.339656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a319b0eb-6397-474c-9d0e-ad8f35e954e5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:06.340227 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a319b0eb-6397-474c-9d0e-ad8f35e954e5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:06.341428 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a319b0eb-6397-474c-9d0e-ad8f35e954e5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:06.342137 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a319b0eb-6397-474c-9d0e-ad8f35e954e5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:06.342593 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a319b0eb-6397-474c-9d0e-ad8f35e954e5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:06.343049 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a319b0eb-6397-474c-9d0e-ad8f35e954e5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:06.409453 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a319b0eb-6397-474c-9d0e-ad8f35e954e5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:06.417642 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a319b0eb-6397-474c-9d0e-ad8f35e954e5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:06.419139 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a319b0eb-6397-474c-9d0e-ad8f35e954e5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:06.420241 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a319b0eb-6397-474c-9d0e-ad8f35e954e5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1286 microversion: 2.20 time: 0.091805 Aug 26 16:02:06.420804 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 422/825] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:02:06 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:02:06.699308 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-cea98d74-8137-4d1a-9930-21e32382e2ad req-6d83382f-6eae-4db5-b848-cd60240a93c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d2e527f-8238-448e-bad8-72e6223612f0", "tag": "9fafeb43-ac51-4d27-a7ea-6b8e26f031a0"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:06.710327 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-cea98d74-8137-4d1a-9930-21e32382e2ad req-6d83382f-6eae-4db5-b848-cd60240a93c0 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:06.710898 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-cea98d74-8137-4d1a-9930-21e32382e2ad req-6d83382f-6eae-4db5-b848-cd60240a93c0 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:06.711499 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-cea98d74-8137-4d1a-9930-21e32382e2ad req-6d83382f-6eae-4db5-b848-cd60240a93c0 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:06.734459 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-cea98d74-8137-4d1a-9930-21e32382e2ad req-6d83382f-6eae-4db5-b848-cd60240a93c0 service nova] Creating event network-changed:9fafeb43-ac51-4d27-a7ea-6b8e26f031a0 for instance 6d2e527f-8238-448e-bad8-72e6223612f0 on hv-cinder-85144 Aug 26 16:02:06.739227 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-cea98d74-8137-4d1a-9930-21e32382e2ad req-6d83382f-6eae-4db5-b848-cd60240a93c0 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044645 Aug 26 16:02:06.739833 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 404/826] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:02:06.787714 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-174165b2-aa6b-40a6-98d2-0ccca3c852c7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:06.788348 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-174165b2-aa6b-40a6-98d2-0ccca3c852c7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:06.796312 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-174165b2-aa6b-40a6-98d2-0ccca3c852c7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:06.796780 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-174165b2-aa6b-40a6-98d2-0ccca3c852c7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:06.797477 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-174165b2-aa6b-40a6-98d2-0ccca3c852c7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:06.798380 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-174165b2-aa6b-40a6-98d2-0ccca3c852c7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:06.799024 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-174165b2-aa6b-40a6-98d2-0ccca3c852c7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:06.799450 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-174165b2-aa6b-40a6-98d2-0ccca3c852c7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:06.840112 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-3ce09ade-e2a9-4f42-a893-5dc1bf017780 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:06.840112 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-3ce09ade-e2a9-4f42-a893-5dc1bf017780 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:06.850720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3ce09ade-e2a9-4f42-a893-5dc1bf017780 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:06.851315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3ce09ade-e2a9-4f42-a893-5dc1bf017780 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:06.851846 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3ce09ade-e2a9-4f42-a893-5dc1bf017780 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:06.852609 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3ce09ade-e2a9-4f42-a893-5dc1bf017780 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:06.853129 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3ce09ade-e2a9-4f42-a893-5dc1bf017780 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:06.853622 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3ce09ade-e2a9-4f42-a893-5dc1bf017780 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:06.871173 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=100 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:07.038757 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-174165b2-aa6b-40a6-98d2-0ccca3c852c7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:07.047070 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-174165b2-aa6b-40a6-98d2-0ccca3c852c7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1260 microversion: 2.1 time: 0.263317 Aug 26 16:02:07.047756 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 423/827] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:06 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1260 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:07.065535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-b397a714-853f-4297-b7e9-9a94a613bddc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:07.066147 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-b397a714-853f-4297-b7e9-9a94a613bddc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:07.066957 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-3ce09ade-e2a9-4f42-a893-5dc1bf017780 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:07.072333 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b397a714-853f-4297-b7e9-9a94a613bddc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:07.072804 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b397a714-853f-4297-b7e9-9a94a613bddc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:07.073238 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b397a714-853f-4297-b7e9-9a94a613bddc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:07.073928 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b397a714-853f-4297-b7e9-9a94a613bddc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:07.074374 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b397a714-853f-4297-b7e9-9a94a613bddc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:07.074796 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b397a714-853f-4297-b7e9-9a94a613bddc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:07.075105 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-3ce09ade-e2a9-4f42-a893-5dc1bf017780 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1366 microversion: 2.1 time: 0.240006 Aug 26 16:02:07.075783 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 405/828] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:06 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:02:07.207070 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b397a714-853f-4297-b7e9-9a94a613bddc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:07.214689 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-b397a714-853f-4297-b7e9-9a94a613bddc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1359 microversion: 2.1 time: 0.153685 Aug 26 16:02:07.215319 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 424/829] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:07 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:07.443279 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f1301718-a773-4a91-9674-ef9d7c8c086d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:07.443889 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-f1301718-a773-4a91-9674-ef9d7c8c086d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:07.450448 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f1301718-a773-4a91-9674-ef9d7c8c086d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:07.453763 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f1301718-a773-4a91-9674-ef9d7c8c086d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:07.453763 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f1301718-a773-4a91-9674-ef9d7c8c086d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:07.453763 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f1301718-a773-4a91-9674-ef9d7c8c086d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:07.453763 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f1301718-a773-4a91-9674-ef9d7c8c086d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:07.454856 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f1301718-a773-4a91-9674-ef9d7c8c086d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:07.516666 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-f1301718-a773-4a91-9674-ef9d7c8c086d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:07.524774 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-f1301718-a773-4a91-9674-ef9d7c8c086d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:07.526216 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-f1301718-a773-4a91-9674-ef9d7c8c086d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:07.527356 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-f1301718-a773-4a91-9674-ef9d7c8c086d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1334 microversion: 2.20 time: 0.088037 Aug 26 16:02:07.527918 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 406/830] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:02:07 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1334 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:02:08.068022 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a10d1ed7-9c3c-4816-905c-91261dd31f53 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:08.068861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a10d1ed7-9c3c-4816-905c-91261dd31f53 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:08.078374 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a10d1ed7-9c3c-4816-905c-91261dd31f53 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:08.078839 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a10d1ed7-9c3c-4816-905c-91261dd31f53 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:08.079304 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a10d1ed7-9c3c-4816-905c-91261dd31f53 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:08.080003 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a10d1ed7-9c3c-4816-905c-91261dd31f53 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:08.080454 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a10d1ed7-9c3c-4816-905c-91261dd31f53 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:08.080876 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a10d1ed7-9c3c-4816-905c-91261dd31f53 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:08.085395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=100 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:08.096598 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-76dc47aa-9aac-48fe-a97b-98050ff61cc4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:08.097203 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-76dc47aa-9aac-48fe-a97b-98050ff61cc4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:08.099802 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:08.108048 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-76dc47aa-9aac-48fe-a97b-98050ff61cc4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:08.108048 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-76dc47aa-9aac-48fe-a97b-98050ff61cc4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:08.108048 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-76dc47aa-9aac-48fe-a97b-98050ff61cc4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:08.108048 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-76dc47aa-9aac-48fe-a97b-98050ff61cc4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:08.108458 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-76dc47aa-9aac-48fe-a97b-98050ff61cc4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:08.108458 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-76dc47aa-9aac-48fe-a97b-98050ff61cc4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:08.312451 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a10d1ed7-9c3c-4816-905c-91261dd31f53 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:08.316797 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-76dc47aa-9aac-48fe-a97b-98050ff61cc4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:08.320270 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a10d1ed7-9c3c-4816-905c-91261dd31f53 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1260 microversion: 2.1 time: 0.256193 Aug 26 16:02:08.321109 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 425/831] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:08 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1260 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:08.325099 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-76dc47aa-9aac-48fe-a97b-98050ff61cc4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1366 microversion: 2.1 time: 0.232592 Aug 26 16:02:08.325801 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 407/832] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:08 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:08.335237 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-2d664950-f0a2-45b8-9db4-1f3d22438f68 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:08.335828 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-2d664950-f0a2-45b8-9db4-1f3d22438f68 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:08.341780 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2d664950-f0a2-45b8-9db4-1f3d22438f68 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:08.342251 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2d664950-f0a2-45b8-9db4-1f3d22438f68 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:08.342698 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2d664950-f0a2-45b8-9db4-1f3d22438f68 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:08.343479 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2d664950-f0a2-45b8-9db4-1f3d22438f68 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:08.343948 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2d664950-f0a2-45b8-9db4-1f3d22438f68 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:08.344368 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2d664950-f0a2-45b8-9db4-1f3d22438f68 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:08.473469 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-2d664950-f0a2-45b8-9db4-1f3d22438f68 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:08.481694 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-2d664950-f0a2-45b8-9db4-1f3d22438f68 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1359 microversion: 2.1 time: 0.159165 Aug 26 16:02:08.482614 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 426/833] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:08 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:08.551349 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-23723a5c-e084-43b4-8b84-c4def86e68bb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:08.551994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-23723a5c-e084-43b4-8b84-c4def86e68bb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:08.558064 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-23723a5c-e084-43b4-8b84-c4def86e68bb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:08.558635 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-23723a5c-e084-43b4-8b84-c4def86e68bb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:08.559104 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-23723a5c-e084-43b4-8b84-c4def86e68bb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:08.560470 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-23723a5c-e084-43b4-8b84-c4def86e68bb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:08.560956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-23723a5c-e084-43b4-8b84-c4def86e68bb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:08.561390 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-23723a5c-e084-43b4-8b84-c4def86e68bb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:08.628625 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-23723a5c-e084-43b4-8b84-c4def86e68bb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:08.636679 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-23723a5c-e084-43b4-8b84-c4def86e68bb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:08.638632 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-23723a5c-e084-43b4-8b84-c4def86e68bb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:08.639764 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-23723a5c-e084-43b4-8b84-c4def86e68bb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1334 microversion: 2.20 time: 0.092580 Aug 26 16:02:08.640317 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 408/834] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:02:08 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1334 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:02:09.342497 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-7ff1a6f0-10c3-408d-9b8c-e8c31c163521 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:09.345722 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-7ff1a6f0-10c3-408d-9b8c-e8c31c163521 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:09.345845 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-e12db100-bb28-48f6-b61e-9367fdb2e92d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:09.346225 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-e12db100-bb28-48f6-b61e-9367fdb2e92d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:09.349754 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7ff1a6f0-10c3-408d-9b8c-e8c31c163521 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:09.350462 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7ff1a6f0-10c3-408d-9b8c-e8c31c163521 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:09.350897 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7ff1a6f0-10c3-408d-9b8c-e8c31c163521 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:09.351615 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7ff1a6f0-10c3-408d-9b8c-e8c31c163521 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:09.352236 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7ff1a6f0-10c3-408d-9b8c-e8c31c163521 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:09.352652 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7ff1a6f0-10c3-408d-9b8c-e8c31c163521 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:09.352780 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e12db100-bb28-48f6-b61e-9367fdb2e92d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:09.353292 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e12db100-bb28-48f6-b61e-9367fdb2e92d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:09.353797 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e12db100-bb28-48f6-b61e-9367fdb2e92d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:09.354668 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e12db100-bb28-48f6-b61e-9367fdb2e92d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:09.355159 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e12db100-bb28-48f6-b61e-9367fdb2e92d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:09.355596 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e12db100-bb28-48f6-b61e-9367fdb2e92d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:09.607144 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e12db100-bb28-48f6-b61e-9367fdb2e92d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:09.615502 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-e12db100-bb28-48f6-b61e-9367fdb2e92d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1555 microversion: 2.1 time: 0.274728 Aug 26 16:02:09.616111 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 409/835] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:09 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1555 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:02:09.616623 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-7ff1a6f0-10c3-408d-9b8c-e8c31c163521 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:09.621208 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-36ac25a3-6718-4608-8a58-f134594e3624 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:09.622402 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-36ac25a3-6718-4608-8a58-f134594e3624 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:09.629309 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-36ac25a3-6718-4608-8a58-f134594e3624 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:09.629604 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-36ac25a3-6718-4608-8a58-f134594e3624 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:09.630332 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-36ac25a3-6718-4608-8a58-f134594e3624 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:09.631154 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-36ac25a3-6718-4608-8a58-f134594e3624 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:09.631615 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-36ac25a3-6718-4608-8a58-f134594e3624 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:09.632034 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-36ac25a3-6718-4608-8a58-f134594e3624 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:09.632890 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-7ff1a6f0-10c3-408d-9b8c-e8c31c163521 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1260 microversion: 2.1 time: 0.295554 Aug 26 16:02:09.633475 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 427/836] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:09 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1260 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:09.649484 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-0ac2d22c-8280-4c0f-bba3-be01968ab024 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:09.649484 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-0ac2d22c-8280-4c0f-bba3-be01968ab024 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:09.649484 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0ac2d22c-8280-4c0f-bba3-be01968ab024 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:09.649484 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0ac2d22c-8280-4c0f-bba3-be01968ab024 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:09.649946 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0ac2d22c-8280-4c0f-bba3-be01968ab024 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:09.649946 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0ac2d22c-8280-4c0f-bba3-be01968ab024 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:09.649946 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0ac2d22c-8280-4c0f-bba3-be01968ab024 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:09.649946 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0ac2d22c-8280-4c0f-bba3-be01968ab024 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:09.776211 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-0ac2d22c-8280-4c0f-bba3-be01968ab024 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.141174 Aug 26 16:02:09.777314 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 428/837] 10.222.0.94 () {58 vars in 1275 bytes} [Fri Aug 26 16:02:09 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:02:09.783775 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-9636ed7c-91d3-4cd4-8940-889aaf15dd7e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:09.784825 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-9636ed7c-91d3-4cd4-8940-889aaf15dd7e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:09.795952 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9636ed7c-91d3-4cd4-8940-889aaf15dd7e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:09.799857 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9636ed7c-91d3-4cd4-8940-889aaf15dd7e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:09.804981 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9636ed7c-91d3-4cd4-8940-889aaf15dd7e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:09.804981 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9636ed7c-91d3-4cd4-8940-889aaf15dd7e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:09.804981 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9636ed7c-91d3-4cd4-8940-889aaf15dd7e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:09.805956 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9636ed7c-91d3-4cd4-8940-889aaf15dd7e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:09.846182 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-36ac25a3-6718-4608-8a58-f134594e3624 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:09.854083 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-36ac25a3-6718-4608-8a58-f134594e3624 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1359 microversion: 2.1 time: 0.236993 Aug 26 16:02:09.854663 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 410/838] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:09 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1359 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:09.875945 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-9636ed7c-91d3-4cd4-8940-889aaf15dd7e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:09.885475 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-9636ed7c-91d3-4cd4-8940-889aaf15dd7e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:09.887009 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-9636ed7c-91d3-4cd4-8940-889aaf15dd7e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:09.888745 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-9636ed7c-91d3-4cd4-8940-889aaf15dd7e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1352 microversion: 2.20 time: 0.108982 Aug 26 16:02:09.889337 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 429/839] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:02:09 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:02:10.658193 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-afeaea75-f9f4-4f87-b1b6-7feb2e5b6b1a tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:10.658725 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-afeaea75-f9f4-4f87-b1b6-7feb2e5b6b1a tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:10.664714 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-afeaea75-f9f4-4f87-b1b6-7feb2e5b6b1a tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:10.665416 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-afeaea75-f9f4-4f87-b1b6-7feb2e5b6b1a tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:10.665850 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-afeaea75-f9f4-4f87-b1b6-7feb2e5b6b1a tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:10.666536 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-afeaea75-f9f4-4f87-b1b6-7feb2e5b6b1a tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:10.667016 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-afeaea75-f9f4-4f87-b1b6-7feb2e5b6b1a tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:10.668661 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-afeaea75-f9f4-4f87-b1b6-7feb2e5b6b1a tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:10.838046 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-afeaea75-f9f4-4f87-b1b6-7feb2e5b6b1a tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:10.847413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-afeaea75-f9f4-4f87-b1b6-7feb2e5b6b1a tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1260 microversion: 2.1 time: 0.194098 Aug 26 16:02:10.848221 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 411/840] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:10 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1260 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:10.875787 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-11c85eee-ec1a-41dd-9529-f88c8f55af30 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:10.876419 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-11c85eee-ec1a-41dd-9529-f88c8f55af30 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:10.882820 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-11c85eee-ec1a-41dd-9529-f88c8f55af30 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:10.883335 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-11c85eee-ec1a-41dd-9529-f88c8f55af30 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:10.883983 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-11c85eee-ec1a-41dd-9529-f88c8f55af30 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:10.884907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-11c85eee-ec1a-41dd-9529-f88c8f55af30 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:10.885366 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-11c85eee-ec1a-41dd-9529-f88c8f55af30 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:10.885962 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-11c85eee-ec1a-41dd-9529-f88c8f55af30 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:10.913531 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-825f3a0a-3ebf-41b3-8cb5-1e1c399ebd1c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:10.917363 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-825f3a0a-3ebf-41b3-8cb5-1e1c399ebd1c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:10.921745 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-825f3a0a-3ebf-41b3-8cb5-1e1c399ebd1c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:10.922577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-825f3a0a-3ebf-41b3-8cb5-1e1c399ebd1c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:10.923290 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-825f3a0a-3ebf-41b3-8cb5-1e1c399ebd1c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:10.924724 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-825f3a0a-3ebf-41b3-8cb5-1e1c399ebd1c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:10.925776 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-825f3a0a-3ebf-41b3-8cb5-1e1c399ebd1c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:10.926459 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-825f3a0a-3ebf-41b3-8cb5-1e1c399ebd1c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:11.078397 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-11c85eee-ec1a-41dd-9529-f88c8f55af30 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:11.088049 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-11c85eee-ec1a-41dd-9529-f88c8f55af30 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1359 microversion: 2.1 time: 0.216501 Aug 26 16:02:11.091169 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 430/841] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:10 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:11.138028 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-825f3a0a-3ebf-41b3-8cb5-1e1c399ebd1c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:11.146429 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-825f3a0a-3ebf-41b3-8cb5-1e1c399ebd1c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:11.148186 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-825f3a0a-3ebf-41b3-8cb5-1e1c399ebd1c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:11.149307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-825f3a0a-3ebf-41b3-8cb5-1e1c399ebd1c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1420 microversion: 2.20 time: 0.240768 Aug 26 16:02:11.149871 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 412/842] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:02:10 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:02:11.463835 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-e08ef6e3-d3d3-40b9-9299-42defd3e2f13 req-32b7641a-b3fc-4542-bb0b-bfd77ae1550c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f241a343-9b6e-471f-9a18-964d506fe4f3", "tag": "726f3f44-7d5b-426a-98ae-f35cdf9b45b9"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:11.476669 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-e08ef6e3-d3d3-40b9-9299-42defd3e2f13 req-32b7641a-b3fc-4542-bb0b-bfd77ae1550c service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:11.477151 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-e08ef6e3-d3d3-40b9-9299-42defd3e2f13 req-32b7641a-b3fc-4542-bb0b-bfd77ae1550c service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:11.477588 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-e08ef6e3-d3d3-40b9-9299-42defd3e2f13 req-32b7641a-b3fc-4542-bb0b-bfd77ae1550c service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:11.482166 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell0:SELECT=2 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:11.490479 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-e08ef6e3-d3d3-40b9-9299-42defd3e2f13 req-32b7641a-b3fc-4542-bb0b-bfd77ae1550c service nova] Creating event network-changed:726f3f44-7d5b-426a-98ae-f35cdf9b45b9 for instance f241a343-9b6e-471f-9a18-964d506fe4f3 on hv-cinder-85144 Aug 26 16:02:11.495955 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-e08ef6e3-d3d3-40b9-9299-42defd3e2f13 req-32b7641a-b3fc-4542-bb0b-bfd77ae1550c service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168880 Aug 26 16:02:11.497444 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 431/843] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:02:11.677663 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-6b6763ee-524f-46f4-8b18-2c1e76b893e5 req-ee9f1f3e-8caa-4fee-bcce-f656ac1109bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b456054b-9e50-43c0-ae5a-8f614cbc102b", "name": "network-vif-plugged", "status": "completed", "tag": "7450399c-70d1-4b9d-9b20-fdef692f4a6d"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:11.692333 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-6b6763ee-524f-46f4-8b18-2c1e76b893e5 req-ee9f1f3e-8caa-4fee-bcce-f656ac1109bc service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:11.693296 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-6b6763ee-524f-46f4-8b18-2c1e76b893e5 req-ee9f1f3e-8caa-4fee-bcce-f656ac1109bc service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:11.693905 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-6b6763ee-524f-46f4-8b18-2c1e76b893e5 req-ee9f1f3e-8caa-4fee-bcce-f656ac1109bc service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:11.713659 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-6b6763ee-524f-46f4-8b18-2c1e76b893e5 req-ee9f1f3e-8caa-4fee-bcce-f656ac1109bc service nova] Creating event network-vif-plugged:7450399c-70d1-4b9d-9b20-fdef692f4a6d for instance b456054b-9e50-43c0-ae5a-8f614cbc102b on hv-cinder-85144 Aug 26 16:02:11.724285 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-6b6763ee-524f-46f4-8b18-2c1e76b893e5 req-ee9f1f3e-8caa-4fee-bcce-f656ac1109bc service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051130 Aug 26 16:02:11.730133 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 413/844] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:02:11.873272 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-94779685-1afd-4860-8a0d-ad89c6910bb7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:11.873767 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-94779685-1afd-4860-8a0d-ad89c6910bb7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:11.877317 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell0:SELECT=12 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:11.882305 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-94779685-1afd-4860-8a0d-ad89c6910bb7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:11.883060 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-94779685-1afd-4860-8a0d-ad89c6910bb7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:11.883660 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-94779685-1afd-4860-8a0d-ad89c6910bb7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:11.884538 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-94779685-1afd-4860-8a0d-ad89c6910bb7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:11.885137 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-94779685-1afd-4860-8a0d-ad89c6910bb7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:11.885807 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-94779685-1afd-4860-8a0d-ad89c6910bb7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:12.114958 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-cf3d6bd1-9972-4a63-9666-6884570d3845 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:12.115774 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-cf3d6bd1-9972-4a63-9666-6884570d3845 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:12.123781 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cf3d6bd1-9972-4a63-9666-6884570d3845 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:12.124414 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cf3d6bd1-9972-4a63-9666-6884570d3845 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:12.126356 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cf3d6bd1-9972-4a63-9666-6884570d3845 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:12.127402 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cf3d6bd1-9972-4a63-9666-6884570d3845 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:12.127881 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cf3d6bd1-9972-4a63-9666-6884570d3845 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:12.128387 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cf3d6bd1-9972-4a63-9666-6884570d3845 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:12.192944 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-94779685-1afd-4860-8a0d-ad89c6910bb7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:12.215111 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-94779685-1afd-4860-8a0d-ad89c6910bb7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1260 microversion: 2.1 time: 0.350590 Aug 26 16:02:12.216323 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 432/845] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:11 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1260 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:02:12.227753 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-89970575-7398-48c7-99ec-0c0f44f299a6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:12.228672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-89970575-7398-48c7-99ec-0c0f44f299a6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:12.236662 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-89970575-7398-48c7-99ec-0c0f44f299a6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:12.237145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-89970575-7398-48c7-99ec-0c0f44f299a6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:12.237572 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-89970575-7398-48c7-99ec-0c0f44f299a6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:12.239067 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-89970575-7398-48c7-99ec-0c0f44f299a6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:12.239517 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-89970575-7398-48c7-99ec-0c0f44f299a6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:12.240105 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-89970575-7398-48c7-99ec-0c0f44f299a6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:12.477047 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-cf3d6bd1-9972-4a63-9666-6884570d3845 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:12.492155 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-cf3d6bd1-9972-4a63-9666-6884570d3845 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1359 microversion: 2.1 time: 0.383962 Aug 26 16:02:12.493699 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 414/846] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:12 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1359 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:02:12.575987 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-89970575-7398-48c7-99ec-0c0f44f299a6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:12.586271 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-89970575-7398-48c7-99ec-0c0f44f299a6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:12.587748 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-89970575-7398-48c7-99ec-0c0f44f299a6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:12.600280 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-89970575-7398-48c7-99ec-0c0f44f299a6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1408 microversion: 2.20 time: 0.371372 Aug 26 16:02:12.600280 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 433/847] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:02:12 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1408 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:02:13.238618 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-d3754516-9164-4de5-9d40-8cf2798a9548 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:13.240047 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-d3754516-9164-4de5-9d40-8cf2798a9548 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:13.242451 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell0:SELECT=4 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:13.247608 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d3754516-9164-4de5-9d40-8cf2798a9548 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:13.251490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d3754516-9164-4de5-9d40-8cf2798a9548 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:13.251490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d3754516-9164-4de5-9d40-8cf2798a9548 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:13.251490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d3754516-9164-4de5-9d40-8cf2798a9548 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:13.251490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d3754516-9164-4de5-9d40-8cf2798a9548 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:13.251899 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d3754516-9164-4de5-9d40-8cf2798a9548 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:13.392912 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-d3754516-9164-4de5-9d40-8cf2798a9548 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:13.400674 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-d3754516-9164-4de5-9d40-8cf2798a9548 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1260 microversion: 2.1 time: 0.165953 Aug 26 16:02:13.401263 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 415/848] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:13 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:13.511845 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-55790dcb-12dc-4722-b6dd-e36446ed3e13 req-2d498be2-750a-427c-833f-88a3d7f211e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fc0c879-6083-414b-b6ee-2046538f526f", "tag": "5921e1e6-5379-4181-b413-94122520d6d1"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:13.514147 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-8701b91b-dca7-4f79-87cd-7821ad5bc609 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:13.514765 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-8701b91b-dca7-4f79-87cd-7821ad5bc609 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:13.521253 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8701b91b-dca7-4f79-87cd-7821ad5bc609 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:13.521748 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8701b91b-dca7-4f79-87cd-7821ad5bc609 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:13.522401 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8701b91b-dca7-4f79-87cd-7821ad5bc609 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:13.522846 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-55790dcb-12dc-4722-b6dd-e36446ed3e13 req-2d498be2-750a-427c-833f-88a3d7f211e7 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:13.523133 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8701b91b-dca7-4f79-87cd-7821ad5bc609 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:13.523543 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-55790dcb-12dc-4722-b6dd-e36446ed3e13 req-2d498be2-750a-427c-833f-88a3d7f211e7 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:13.523703 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8701b91b-dca7-4f79-87cd-7821ad5bc609 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:13.523967 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-55790dcb-12dc-4722-b6dd-e36446ed3e13 req-2d498be2-750a-427c-833f-88a3d7f211e7 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:13.524088 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8701b91b-dca7-4f79-87cd-7821ad5bc609 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:13.536801 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-55790dcb-12dc-4722-b6dd-e36446ed3e13 req-2d498be2-750a-427c-833f-88a3d7f211e7 service nova] Creating event network-changed:5921e1e6-5379-4181-b413-94122520d6d1 for instance 3fc0c879-6083-414b-b6ee-2046538f526f on hv-cinder-85144 Aug 26 16:02:13.541731 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-55790dcb-12dc-4722-b6dd-e36446ed3e13 req-2d498be2-750a-427c-833f-88a3d7f211e7 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034289 Aug 26 16:02:13.545538 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 434/849] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:02:13.613935 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-ba7fdc19-011d-48b7-941a-7dca11db27da tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:13.614668 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-ba7fdc19-011d-48b7-941a-7dca11db27da tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:13.620963 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ba7fdc19-011d-48b7-941a-7dca11db27da tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:13.621470 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ba7fdc19-011d-48b7-941a-7dca11db27da tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:13.621961 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ba7fdc19-011d-48b7-941a-7dca11db27da tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:13.622648 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ba7fdc19-011d-48b7-941a-7dca11db27da tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:13.623160 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ba7fdc19-011d-48b7-941a-7dca11db27da tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:13.623589 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ba7fdc19-011d-48b7-941a-7dca11db27da tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:13.674544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-8701b91b-dca7-4f79-87cd-7821ad5bc609 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:13.682358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-8701b91b-dca7-4f79-87cd-7821ad5bc609 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1359 microversion: 2.1 time: 0.172796 Aug 26 16:02:13.683038 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 416/850] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:13 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:02:13.770501 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-ba7fdc19-011d-48b7-941a-7dca11db27da tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:13.779888 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-ba7fdc19-011d-48b7-941a-7dca11db27da tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:13.781359 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-ba7fdc19-011d-48b7-941a-7dca11db27da tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:13.782472 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-ba7fdc19-011d-48b7-941a-7dca11db27da tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1408 microversion: 2.20 time: 0.172960 Aug 26 16:02:13.783062 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 435/851] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:02:13 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:02:14.421821 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-c772af2f-d0c1-43e0-b0ca-acdacdbd9ffb tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:14.422423 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-c772af2f-d0c1-43e0-b0ca-acdacdbd9ffb tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:14.428928 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c772af2f-d0c1-43e0-b0ca-acdacdbd9ffb tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:14.429406 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c772af2f-d0c1-43e0-b0ca-acdacdbd9ffb tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:14.429833 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c772af2f-d0c1-43e0-b0ca-acdacdbd9ffb tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:14.430521 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c772af2f-d0c1-43e0-b0ca-acdacdbd9ffb tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:14.430986 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c772af2f-d0c1-43e0-b0ca-acdacdbd9ffb tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:14.431407 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c772af2f-d0c1-43e0-b0ca-acdacdbd9ffb tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:14.526538 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-84c26099-4237-476e-9661-fe0b37c29dbd tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:14.529405 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-84c26099-4237-476e-9661-fe0b37c29dbd tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:14.535380 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-84c26099-4237-476e-9661-fe0b37c29dbd tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:14.541241 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-84c26099-4237-476e-9661-fe0b37c29dbd tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:14.541241 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-84c26099-4237-476e-9661-fe0b37c29dbd tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:14.541241 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-84c26099-4237-476e-9661-fe0b37c29dbd tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:14.541241 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-84c26099-4237-476e-9661-fe0b37c29dbd tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:14.541622 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-84c26099-4237-476e-9661-fe0b37c29dbd tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:14.567638 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-84c26099-4237-476e-9661-fe0b37c29dbd tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045118 Aug 26 16:02:14.568392 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 436/852] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:02:14 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 26 16:02:14.571352 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-c772af2f-d0c1-43e0-b0ca-acdacdbd9ffb tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:14.579926 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-c772af2f-d0c1-43e0-b0ca-acdacdbd9ffb tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1260 microversion: 2.1 time: 0.162151 Aug 26 16:02:14.580504 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 417/853] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:14 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:14.630375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-601824f3-887f-469b-b114-7a077ad38aea tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:14.630885 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-601824f3-887f-469b-b114-7a077ad38aea tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:14.636717 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-601824f3-887f-469b-b114-7a077ad38aea tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:14.637222 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-601824f3-887f-469b-b114-7a077ad38aea tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:14.638232 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-601824f3-887f-469b-b114-7a077ad38aea tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:14.638909 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-601824f3-887f-469b-b114-7a077ad38aea tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:14.639371 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-601824f3-887f-469b-b114-7a077ad38aea tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:14.639789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-601824f3-887f-469b-b114-7a077ad38aea tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:14.663639 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-601824f3-887f-469b-b114-7a077ad38aea tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Going to try to terminate instance {{(pid=128305) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 16:02:14.704557 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-5d770c19-dfbb-4c95-9a4a-02222aa13cbc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:14.705169 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-5d770c19-dfbb-4c95-9a4a-02222aa13cbc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:14.711344 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d770c19-dfbb-4c95-9a4a-02222aa13cbc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:14.711795 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d770c19-dfbb-4c95-9a4a-02222aa13cbc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:14.712231 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d770c19-dfbb-4c95-9a4a-02222aa13cbc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:14.712950 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d770c19-dfbb-4c95-9a4a-02222aa13cbc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:14.713403 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d770c19-dfbb-4c95-9a4a-02222aa13cbc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:14.713830 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d770c19-dfbb-4c95-9a4a-02222aa13cbc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:14.845534 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-5d770c19-dfbb-4c95-9a4a-02222aa13cbc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:14.853297 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-5d770c19-dfbb-4c95-9a4a-02222aa13cbc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1359 microversion: 2.1 time: 0.153782 Aug 26 16:02:14.853868 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 418/854] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:14 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:02:14.858521 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-5f05a76f-f3cf-4d45-927d-3d166989f44d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:14.859153 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-5f05a76f-f3cf-4d45-927d-3d166989f44d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:14.864827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5f05a76f-f3cf-4d45-927d-3d166989f44d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:14.865308 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5f05a76f-f3cf-4d45-927d-3d166989f44d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:14.865747 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5f05a76f-f3cf-4d45-927d-3d166989f44d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:14.866441 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5f05a76f-f3cf-4d45-927d-3d166989f44d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:14.866900 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5f05a76f-f3cf-4d45-927d-3d166989f44d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:14.867378 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5f05a76f-f3cf-4d45-927d-3d166989f44d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:15.004432 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-5f05a76f-f3cf-4d45-927d-3d166989f44d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:15.012567 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-5f05a76f-f3cf-4d45-927d-3d166989f44d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:15.014015 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-5f05a76f-f3cf-4d45-927d-3d166989f44d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:15.015150 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-5f05a76f-f3cf-4d45-927d-3d166989f44d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1408 microversion: 2.20 time: 0.160340 Aug 26 16:02:15.015742 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 419/855] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:02:14 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:02:15.024061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-601824f3-887f-469b-b114-7a077ad38aea tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "DELETE /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 204 len: 0 microversion: 2.1 time: 0.397090 Aug 26 16:02:15.024644 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 437/856] 10.222.0.94 () {58 vars in 1239 bytes} [Fri Aug 26 16:02:14 2022] DELETE /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 16:02:15.032863 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-fbce51c9-8e04-4e1f-b2ad-8ec898901054 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:15.033471 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-fbce51c9-8e04-4e1f-b2ad-8ec898901054 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:15.039514 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fbce51c9-8e04-4e1f-b2ad-8ec898901054 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:15.040004 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fbce51c9-8e04-4e1f-b2ad-8ec898901054 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:15.040443 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fbce51c9-8e04-4e1f-b2ad-8ec898901054 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:15.041138 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fbce51c9-8e04-4e1f-b2ad-8ec898901054 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:15.041598 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fbce51c9-8e04-4e1f-b2ad-8ec898901054 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:15.042028 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fbce51c9-8e04-4e1f-b2ad-8ec898901054 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:15.173900 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-fbce51c9-8e04-4e1f-b2ad-8ec898901054 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:15.181625 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-fbce51c9-8e04-4e1f-b2ad-8ec898901054 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1674 microversion: 2.1 time: 0.152566 Aug 26 16:02:15.182194 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 420/857] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:15 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:15.601607 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-25165f66-57e3-4a33-8560-ddb6e54c21f2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:15.602315 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-25165f66-57e3-4a33-8560-ddb6e54c21f2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:15.608477 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-25165f66-57e3-4a33-8560-ddb6e54c21f2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:15.608957 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-25165f66-57e3-4a33-8560-ddb6e54c21f2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:15.609392 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-25165f66-57e3-4a33-8560-ddb6e54c21f2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:15.610090 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-25165f66-57e3-4a33-8560-ddb6e54c21f2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:15.610543 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-25165f66-57e3-4a33-8560-ddb6e54c21f2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:15.610996 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-25165f66-57e3-4a33-8560-ddb6e54c21f2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:15.656680 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-b01212fe-5b1a-42ad-a865-9c0efce575c6 req-053aec1f-9ca8-4ead-9bd7-216e6771ea95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d2e527f-8238-448e-bad8-72e6223612f0", "name": "network-vif-plugged", "status": "completed", "tag": "9fafeb43-ac51-4d27-a7ea-6b8e26f031a0"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:15.669292 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-b01212fe-5b1a-42ad-a865-9c0efce575c6 req-053aec1f-9ca8-4ead-9bd7-216e6771ea95 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:15.669962 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-b01212fe-5b1a-42ad-a865-9c0efce575c6 req-053aec1f-9ca8-4ead-9bd7-216e6771ea95 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:15.670469 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-b01212fe-5b1a-42ad-a865-9c0efce575c6 req-053aec1f-9ca8-4ead-9bd7-216e6771ea95 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:15.685738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-b01212fe-5b1a-42ad-a865-9c0efce575c6 req-053aec1f-9ca8-4ead-9bd7-216e6771ea95 service nova] Creating event network-vif-plugged:9fafeb43-ac51-4d27-a7ea-6b8e26f031a0 for instance 6d2e527f-8238-448e-bad8-72e6223612f0 on hv-cinder-85144 Aug 26 16:02:15.690820 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-b01212fe-5b1a-42ad-a865-9c0efce575c6 req-053aec1f-9ca8-4ead-9bd7-216e6771ea95 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039569 Aug 26 16:02:15.691600 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 421/858] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:02:15.755026 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-25165f66-57e3-4a33-8560-ddb6e54c21f2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:15.762909 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-25165f66-57e3-4a33-8560-ddb6e54c21f2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1444 microversion: 2.1 time: 0.165504 Aug 26 16:02:15.763610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 438/859] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:15 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1444 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:15.783676 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-b69855bf-6d10-4ab5-b6cd-86a173ed8236 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:15.784370 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-b69855bf-6d10-4ab5-b6cd-86a173ed8236 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:15.790478 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b69855bf-6d10-4ab5-b6cd-86a173ed8236 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:15.790988 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b69855bf-6d10-4ab5-b6cd-86a173ed8236 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:15.791425 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b69855bf-6d10-4ab5-b6cd-86a173ed8236 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:15.792113 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b69855bf-6d10-4ab5-b6cd-86a173ed8236 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:15.792564 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b69855bf-6d10-4ab5-b6cd-86a173ed8236 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:15.792991 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b69855bf-6d10-4ab5-b6cd-86a173ed8236 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:15.874792 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-20072574-caec-454c-af08-1fe51c06c8b8 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:15.875496 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-20072574-caec-454c-af08-1fe51c06c8b8 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:15.881712 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-20072574-caec-454c-af08-1fe51c06c8b8 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:15.882190 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-20072574-caec-454c-af08-1fe51c06c8b8 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:15.882624 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-20072574-caec-454c-af08-1fe51c06c8b8 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:15.883621 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-20072574-caec-454c-af08-1fe51c06c8b8 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:15.885342 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-20072574-caec-454c-af08-1fe51c06c8b8 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:15.885777 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-20072574-caec-454c-af08-1fe51c06c8b8 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:15.928810 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-b69855bf-6d10-4ab5-b6cd-86a173ed8236 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:15.941325 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-b69855bf-6d10-4ab5-b6cd-86a173ed8236 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1444 microversion: 2.1 time: 0.161394 Aug 26 16:02:15.942419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 422/860] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:15 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1444 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:16.031960 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-20072574-caec-454c-af08-1fe51c06c8b8 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:16.038169 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-6612830c-f760-42ff-9482-c16473c4534d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:16.038811 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-6612830c-f760-42ff-9482-c16473c4534d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:16.040117 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-20072574-caec-454c-af08-1fe51c06c8b8 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1359 microversion: 2.1 time: 0.169884 Aug 26 16:02:16.041093 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 439/861] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:15 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:02:16.058881 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6612830c-f760-42ff-9482-c16473c4534d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:16.060793 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6612830c-f760-42ff-9482-c16473c4534d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:16.061773 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6612830c-f760-42ff-9482-c16473c4534d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:16.062496 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6612830c-f760-42ff-9482-c16473c4534d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:16.062980 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6612830c-f760-42ff-9482-c16473c4534d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:16.063417 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6612830c-f760-42ff-9482-c16473c4534d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:16.079537 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=100 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:16.204661 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-4d2dfb98-fab4-495f-963c-ad60394ae25b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:16.205221 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-4d2dfb98-fab4-495f-963c-ad60394ae25b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:16.208904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-6612830c-f760-42ff-9482-c16473c4534d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:16.210711 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:16.214631 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4d2dfb98-fab4-495f-963c-ad60394ae25b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:16.215147 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4d2dfb98-fab4-495f-963c-ad60394ae25b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:16.216204 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4d2dfb98-fab4-495f-963c-ad60394ae25b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:16.216908 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4d2dfb98-fab4-495f-963c-ad60394ae25b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:16.217379 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4d2dfb98-fab4-495f-963c-ad60394ae25b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:16.217825 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4d2dfb98-fab4-495f-963c-ad60394ae25b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:16.219544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-6612830c-f760-42ff-9482-c16473c4534d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:16.221093 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-6612830c-f760-42ff-9482-c16473c4534d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:16.235099 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-6612830c-f760-42ff-9482-c16473c4534d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1408 microversion: 2.20 time: 0.188117 Aug 26 16:02:16.235817 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 423/862] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:02:16 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:02:16.510980 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-4d2dfb98-fab4-495f-963c-ad60394ae25b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:16.519954 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-4d2dfb98-fab4-495f-963c-ad60394ae25b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1674 microversion: 2.1 time: 0.320098 Aug 26 16:02:16.520678 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 440/863] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:16 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1674 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:02:17.063134 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f528321b-b218-453f-bd16-825d2edd7824 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:17.063814 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-f528321b-b218-453f-bd16-825d2edd7824 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:17.070659 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f528321b-b218-453f-bd16-825d2edd7824 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:17.071180 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f528321b-b218-453f-bd16-825d2edd7824 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:17.071620 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f528321b-b218-453f-bd16-825d2edd7824 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:17.072322 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f528321b-b218-453f-bd16-825d2edd7824 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:17.072855 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f528321b-b218-453f-bd16-825d2edd7824 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:17.073302 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f528321b-b218-453f-bd16-825d2edd7824 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:17.208168 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-f528321b-b218-453f-bd16-825d2edd7824 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:17.216209 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-f528321b-b218-453f-bd16-825d2edd7824 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1359 microversion: 2.1 time: 0.158169 Aug 26 16:02:17.216803 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 424/864] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:17 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:17.250212 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-2fd8dcdf-c551-4cec-be7d-42b3e6ab3791 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:17.250836 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-2fd8dcdf-c551-4cec-be7d-42b3e6ab3791 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:17.257808 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2fd8dcdf-c551-4cec-be7d-42b3e6ab3791 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:17.259672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2fd8dcdf-c551-4cec-be7d-42b3e6ab3791 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:17.259672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2fd8dcdf-c551-4cec-be7d-42b3e6ab3791 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:17.259672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2fd8dcdf-c551-4cec-be7d-42b3e6ab3791 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:17.260043 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2fd8dcdf-c551-4cec-be7d-42b3e6ab3791 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:17.260313 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2fd8dcdf-c551-4cec-be7d-42b3e6ab3791 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:17.391797 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-2fd8dcdf-c551-4cec-be7d-42b3e6ab3791 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:17.395616 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:17.400630 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-2fd8dcdf-c551-4cec-be7d-42b3e6ab3791 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:17.410578 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-2fd8dcdf-c551-4cec-be7d-42b3e6ab3791 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:17.410578 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-2fd8dcdf-c551-4cec-be7d-42b3e6ab3791 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1408 microversion: 2.20 time: 0.157637 Aug 26 16:02:17.410578 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 441/865] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:02:17 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:02:17.541994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-354852cb-6ddb-46f1-9fba-79a2bb01f7b9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:17.542615 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-354852cb-6ddb-46f1-9fba-79a2bb01f7b9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:17.553141 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-354852cb-6ddb-46f1-9fba-79a2bb01f7b9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:17.554093 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-354852cb-6ddb-46f1-9fba-79a2bb01f7b9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:17.554694 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-354852cb-6ddb-46f1-9fba-79a2bb01f7b9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:17.555621 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-354852cb-6ddb-46f1-9fba-79a2bb01f7b9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:17.556316 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-354852cb-6ddb-46f1-9fba-79a2bb01f7b9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:17.557249 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-354852cb-6ddb-46f1-9fba-79a2bb01f7b9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:17.708435 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-354852cb-6ddb-46f1-9fba-79a2bb01f7b9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:17.717410 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-354852cb-6ddb-46f1-9fba-79a2bb01f7b9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1674 microversion: 2.1 time: 0.179515 Aug 26 16:02:17.718187 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 425/866] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:17 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1674 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:02:18.237246 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-59d2e084-eb9f-4f85-a428-5749d619579e tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:18.238127 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-59d2e084-eb9f-4f85-a428-5749d619579e tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:18.252879 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-59d2e084-eb9f-4f85-a428-5749d619579e tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:18.254692 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-59d2e084-eb9f-4f85-a428-5749d619579e tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:18.255089 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-59d2e084-eb9f-4f85-a428-5749d619579e tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:18.255812 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-59d2e084-eb9f-4f85-a428-5749d619579e tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:18.256263 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-59d2e084-eb9f-4f85-a428-5749d619579e tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:18.256680 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-59d2e084-eb9f-4f85-a428-5749d619579e tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:18.430450 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-1625b28d-42f2-42cc-bf2c-1d8a4721b31b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:18.431655 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-1625b28d-42f2-42cc-bf2c-1d8a4721b31b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:18.439487 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1625b28d-42f2-42cc-bf2c-1d8a4721b31b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:18.440347 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1625b28d-42f2-42cc-bf2c-1d8a4721b31b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:18.440945 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1625b28d-42f2-42cc-bf2c-1d8a4721b31b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:18.442521 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1625b28d-42f2-42cc-bf2c-1d8a4721b31b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:18.443254 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1625b28d-42f2-42cc-bf2c-1d8a4721b31b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:18.443880 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1625b28d-42f2-42cc-bf2c-1d8a4721b31b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:18.567930 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-59d2e084-eb9f-4f85-a428-5749d619579e tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:18.576587 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-59d2e084-eb9f-4f85-a428-5749d619579e tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1359 microversion: 2.1 time: 0.343790 Aug 26 16:02:18.591852 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 442/867] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:18 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1359 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:18.597393 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-366842cb-d734-47f4-a1ef-0baea790fc69 req-0f0ae74d-4f85-436f-9886-629b1e87846c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b456054b-9e50-43c0-ae5a-8f614cbc102b", "tag": "7450399c-70d1-4b9d-9b20-fdef692f4a6d"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:18.609374 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-366842cb-d734-47f4-a1ef-0baea790fc69 req-0f0ae74d-4f85-436f-9886-629b1e87846c service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:18.609864 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-366842cb-d734-47f4-a1ef-0baea790fc69 req-0f0ae74d-4f85-436f-9886-629b1e87846c service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:18.610294 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-366842cb-d734-47f4-a1ef-0baea790fc69 req-0f0ae74d-4f85-436f-9886-629b1e87846c service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:18.626169 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-366842cb-d734-47f4-a1ef-0baea790fc69 req-0f0ae74d-4f85-436f-9886-629b1e87846c service nova] Creating event network-changed:7450399c-70d1-4b9d-9b20-fdef692f4a6d for instance b456054b-9e50-43c0-ae5a-8f614cbc102b on hv-cinder-85144 Aug 26 16:02:18.631898 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-366842cb-d734-47f4-a1ef-0baea790fc69 req-0f0ae74d-4f85-436f-9886-629b1e87846c service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038444 Aug 26 16:02:18.632960 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 443/868] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:02:18.740810 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-b6b338ef-6b02-4480-a463-907f215a5b94 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:18.741774 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-b6b338ef-6b02-4480-a463-907f215a5b94 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:18.749554 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b6b338ef-6b02-4480-a463-907f215a5b94 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:18.750156 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b6b338ef-6b02-4480-a463-907f215a5b94 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:18.750653 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b6b338ef-6b02-4480-a463-907f215a5b94 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:18.751685 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b6b338ef-6b02-4480-a463-907f215a5b94 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:18.752211 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b6b338ef-6b02-4480-a463-907f215a5b94 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:18.752861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b6b338ef-6b02-4480-a463-907f215a5b94 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:19.032230 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-1625b28d-42f2-42cc-bf2c-1d8a4721b31b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:19.041500 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-1625b28d-42f2-42cc-bf2c-1d8a4721b31b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:19.042956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-1625b28d-42f2-42cc-bf2c-1d8a4721b31b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:19.044170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-1625b28d-42f2-42cc-bf2c-1d8a4721b31b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1408 microversion: 2.20 time: 0.619807 Aug 26 16:02:19.045498 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 426/869] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:02:18 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1408 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:02:19.117598 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b6b338ef-6b02-4480-a463-907f215a5b94 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:19.127012 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-b6b338ef-6b02-4480-a463-907f215a5b94 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1674 microversion: 2.1 time: 0.391317 Aug 26 16:02:19.127773 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 444/870] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:18 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1674 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:02:19.599012 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-c29b2592-71fd-442a-902b-fb49abe0bc3d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:19.599866 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-c29b2592-71fd-442a-902b-fb49abe0bc3d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:19.610868 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c29b2592-71fd-442a-902b-fb49abe0bc3d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:19.611431 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c29b2592-71fd-442a-902b-fb49abe0bc3d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:19.612282 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c29b2592-71fd-442a-902b-fb49abe0bc3d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:19.613024 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c29b2592-71fd-442a-902b-fb49abe0bc3d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:19.614160 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c29b2592-71fd-442a-902b-fb49abe0bc3d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:19.614745 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c29b2592-71fd-442a-902b-fb49abe0bc3d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:19.642040 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-5c1207dd-1a71-4497-ad3b-827dfbe767fe req-e91c9d3f-7c1f-4327-967d-a6616c689897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0e476ca-b4b7-4537-bfca-2c66b7246c3e", "name": "network-vif-deleted", "tag": "51cd4e58-b1f3-4e1f-b212-98868414d616"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:19.661766 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-5c1207dd-1a71-4497-ad3b-827dfbe767fe req-e91c9d3f-7c1f-4327-967d-a6616c689897 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:19.668149 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-5c1207dd-1a71-4497-ad3b-827dfbe767fe req-e91c9d3f-7c1f-4327-967d-a6616c689897 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:19.669382 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-5c1207dd-1a71-4497-ad3b-827dfbe767fe req-e91c9d3f-7c1f-4327-967d-a6616c689897 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:19.698176 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-5c1207dd-1a71-4497-ad3b-827dfbe767fe req-e91c9d3f-7c1f-4327-967d-a6616c689897 service nova] Creating event network-vif-deleted:51cd4e58-b1f3-4e1f-b212-98868414d616 for instance f0e476ca-b4b7-4537-bfca-2c66b7246c3e on hv-cinder-85144 Aug 26 16:02:19.716355 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-5c1207dd-1a71-4497-ad3b-827dfbe767fe req-e91c9d3f-7c1f-4327-967d-a6616c689897 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165728 Aug 26 16:02:19.717255 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 427/871] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:02:19.802838 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-bf3e303e-4209-4b4a-b5fe-259c95881167 req-80be21cc-40f4-42b7-8bca-5bab892924f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fc0c879-6083-414b-b6ee-2046538f526f", "name": "network-vif-plugged", "status": "completed", "tag": "5921e1e6-5379-4181-b413-94122520d6d1"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:19.817096 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-bf3e303e-4209-4b4a-b5fe-259c95881167 req-80be21cc-40f4-42b7-8bca-5bab892924f4 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:19.817830 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-bf3e303e-4209-4b4a-b5fe-259c95881167 req-80be21cc-40f4-42b7-8bca-5bab892924f4 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:19.818434 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-bf3e303e-4209-4b4a-b5fe-259c95881167 req-80be21cc-40f4-42b7-8bca-5bab892924f4 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:19.823791 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-c29b2592-71fd-442a-902b-fb49abe0bc3d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:19.833278 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-c29b2592-71fd-442a-902b-fb49abe0bc3d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1359 microversion: 2.1 time: 0.239312 Aug 26 16:02:19.834606 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 445/872] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:19 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:19.850319 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-bf3e303e-4209-4b4a-b5fe-259c95881167 req-80be21cc-40f4-42b7-8bca-5bab892924f4 service nova] Creating event network-vif-plugged:5921e1e6-5379-4181-b413-94122520d6d1 for instance 3fc0c879-6083-414b-b6ee-2046538f526f on hv-cinder-85144 Aug 26 16:02:19.855835 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-bf3e303e-4209-4b4a-b5fe-259c95881167 req-80be21cc-40f4-42b7-8bca-5bab892924f4 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057672 Aug 26 16:02:19.857011 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 428/873] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:02:20.066226 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-f748af91-8082-410f-b30e-380b84b21699 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:20.067798 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-f748af91-8082-410f-b30e-380b84b21699 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:20.073118 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f748af91-8082-410f-b30e-380b84b21699 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:20.073594 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f748af91-8082-410f-b30e-380b84b21699 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:20.074028 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f748af91-8082-410f-b30e-380b84b21699 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:20.074778 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f748af91-8082-410f-b30e-380b84b21699 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:20.075569 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f748af91-8082-410f-b30e-380b84b21699 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:20.076161 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f748af91-8082-410f-b30e-380b84b21699 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:20.148612 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-b677bb79-2b15-4419-85d0-e717a59049a0 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:20.149458 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-b677bb79-2b15-4419-85d0-e717a59049a0 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:20.157411 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b677bb79-2b15-4419-85d0-e717a59049a0 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:20.157970 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b677bb79-2b15-4419-85d0-e717a59049a0 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:20.158413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b677bb79-2b15-4419-85d0-e717a59049a0 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:20.165985 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b677bb79-2b15-4419-85d0-e717a59049a0 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:20.165985 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b677bb79-2b15-4419-85d0-e717a59049a0 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:20.165985 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b677bb79-2b15-4419-85d0-e717a59049a0 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:20.246648 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-b677bb79-2b15-4419-85d0-e717a59049a0 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:20.268056 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-b677bb79-2b15-4419-85d0-e717a59049a0 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1606 microversion: 2.1 time: 0.123409 Aug 26 16:02:20.268716 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 429/874] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:20 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1606 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:20.283464 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-f748af91-8082-410f-b30e-380b84b21699 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:20.294436 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-f748af91-8082-410f-b30e-380b84b21699 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:20.295946 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-f748af91-8082-410f-b30e-380b84b21699 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:20.297299 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-f748af91-8082-410f-b30e-380b84b21699 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1408 microversion: 2.20 time: 0.235220 Aug 26 16:02:20.297857 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 446/875] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:02:20 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:02:20.854786 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ae37c1c5-edb3-4eae-9b5e-64eec6419466 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:20.855475 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ae37c1c5-edb3-4eae-9b5e-64eec6419466 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:20.862241 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ae37c1c5-edb3-4eae-9b5e-64eec6419466 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:20.862725 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ae37c1c5-edb3-4eae-9b5e-64eec6419466 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:20.863206 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ae37c1c5-edb3-4eae-9b5e-64eec6419466 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:20.863904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ae37c1c5-edb3-4eae-9b5e-64eec6419466 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:20.864367 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ae37c1c5-edb3-4eae-9b5e-64eec6419466 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:20.864797 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ae37c1c5-edb3-4eae-9b5e-64eec6419466 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:20.999434 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-ae37c1c5-edb3-4eae-9b5e-64eec6419466 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:21.008399 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ae37c1c5-edb3-4eae-9b5e-64eec6419466 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1549 microversion: 2.1 time: 0.157552 Aug 26 16:02:21.009014 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 430/876] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:20 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:21.028373 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-8bb07b68-ac80-4a2d-aced-98cae3e98918 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:21.028986 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-8bb07b68-ac80-4a2d-aced-98cae3e98918 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:21.035431 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8bb07b68-ac80-4a2d-aced-98cae3e98918 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:21.035943 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8bb07b68-ac80-4a2d-aced-98cae3e98918 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:21.036376 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8bb07b68-ac80-4a2d-aced-98cae3e98918 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:21.037056 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8bb07b68-ac80-4a2d-aced-98cae3e98918 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:21.037504 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8bb07b68-ac80-4a2d-aced-98cae3e98918 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:21.037922 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8bb07b68-ac80-4a2d-aced-98cae3e98918 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:21.167861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-8bb07b68-ac80-4a2d-aced-98cae3e98918 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:21.176188 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-8bb07b68-ac80-4a2d-aced-98cae3e98918 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1549 microversion: 2.1 time: 0.151702 Aug 26 16:02:21.176754 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 447/877] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:21 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:21.196640 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-42aaec36-afd5-4612-b511-8b2bac4df8a9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:21.201573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-42aaec36-afd5-4612-b511-8b2bac4df8a9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:21.202331 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-42aaec36-afd5-4612-b511-8b2bac4df8a9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Searching by: {'deleted': False, 'project_id': '070e0f497888488d863e2f63b87a31ff'} {{(pid=128304) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 26 16:02:21.208949 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42aaec36-afd5-4612-b511-8b2bac4df8a9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:21.209425 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42aaec36-afd5-4612-b511-8b2bac4df8a9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:21.209861 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42aaec36-afd5-4612-b511-8b2bac4df8a9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:21.210582 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42aaec36-afd5-4612-b511-8b2bac4df8a9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:21.211074 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42aaec36-afd5-4612-b511-8b2bac4df8a9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:21.211503 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42aaec36-afd5-4612-b511-8b2bac4df8a9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:21.291280 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-1befcafc-ba03-4b2a-b241-39105e99fff7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:21.291906 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-1befcafc-ba03-4b2a-b241-39105e99fff7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:21.298941 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1befcafc-ba03-4b2a-b241-39105e99fff7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:21.299478 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1befcafc-ba03-4b2a-b241-39105e99fff7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:21.299919 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1befcafc-ba03-4b2a-b241-39105e99fff7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:21.300649 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1befcafc-ba03-4b2a-b241-39105e99fff7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:21.301164 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1befcafc-ba03-4b2a-b241-39105e99fff7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:21.301595 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1befcafc-ba03-4b2a-b241-39105e99fff7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:21.343259 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1befcafc-ba03-4b2a-b241-39105e99fff7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:21.343259 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1befcafc-ba03-4b2a-b241-39105e99fff7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:21.343259 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1befcafc-ba03-4b2a-b241-39105e99fff7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:21.343259 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-1befcafc-ba03-4b2a-b241-39105e99fff7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lazy-loading 'fault' on Instance uuid f0e476ca-b4b7-4537-bfca-2c66b7246c3e {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:02:21.382893 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-1befcafc-ba03-4b2a-b241-39105e99fff7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:21.391402 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-1befcafc-ba03-4b2a-b241-39105e99fff7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1327 microversion: 2.1 time: 0.104041 Aug 26 16:02:21.392002 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 448/878] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:21 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1327 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:02:21.396830 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-b394b565-4f37-4b09-beae-c5787c51fe4a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:21.397432 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-b394b565-4f37-4b09-beae-c5787c51fe4a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:21.404583 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b394b565-4f37-4b09-beae-c5787c51fe4a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:21.405074 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b394b565-4f37-4b09-beae-c5787c51fe4a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:21.405510 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b394b565-4f37-4b09-beae-c5787c51fe4a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:21.406213 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b394b565-4f37-4b09-beae-c5787c51fe4a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:21.406666 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b394b565-4f37-4b09-beae-c5787c51fe4a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:21.407119 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b394b565-4f37-4b09-beae-c5787c51fe4a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:21.461095 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.multi_cell_list [None req-42aaec36-afd5-4612-b511-8b2bac4df8a9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 26 16:02:21.553192 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b394b565-4f37-4b09-beae-c5787c51fe4a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:21.557733 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-42aaec36-afd5-4612-b511-8b2bac4df8a9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.365077 Aug 26 16:02:21.558514 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 431/879] 10.222.0.94 () {58 vars in 1125 bytes} [Fri Aug 26 16:02:21 2022] GET /compute/v2.1/servers => generated 343 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:02:21.562542 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b394b565-4f37-4b09-beae-c5787c51fe4a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:21.563998 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b394b565-4f37-4b09-beae-c5787c51fe4a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:21.565431 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-b394b565-4f37-4b09-beae-c5787c51fe4a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1408 microversion: 2.20 time: 0.172438 Aug 26 16:02:21.566350 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 449/880] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:02:21 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:02:21.571297 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-d2488796-3e3d-4428-9d42-ddd31507560b tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:21.571907 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-d2488796-3e3d-4428-9d42-ddd31507560b tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:21.579109 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d2488796-3e3d-4428-9d42-ddd31507560b tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:21.579593 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d2488796-3e3d-4428-9d42-ddd31507560b tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:21.580021 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d2488796-3e3d-4428-9d42-ddd31507560b tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:21.580716 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d2488796-3e3d-4428-9d42-ddd31507560b tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:21.581160 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d2488796-3e3d-4428-9d42-ddd31507560b tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:21.581581 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d2488796-3e3d-4428-9d42-ddd31507560b tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:21.717015 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-d2488796-3e3d-4428-9d42-ddd31507560b tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:21.725256 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-d2488796-3e3d-4428-9d42-ddd31507560b tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1549 microversion: 2.1 time: 0.158857 Aug 26 16:02:21.726065 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 432/881] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:21 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:22.414259 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-c477522f-a5c9-4dae-93cf-a5ddb733656a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:22.414864 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-c477522f-a5c9-4dae-93cf-a5ddb733656a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:22.422288 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c477522f-a5c9-4dae-93cf-a5ddb733656a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:22.428825 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c477522f-a5c9-4dae-93cf-a5ddb733656a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:22.428825 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c477522f-a5c9-4dae-93cf-a5ddb733656a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:22.428825 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c477522f-a5c9-4dae-93cf-a5ddb733656a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:22.428825 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c477522f-a5c9-4dae-93cf-a5ddb733656a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:22.429195 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c477522f-a5c9-4dae-93cf-a5ddb733656a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:22.457537 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c477522f-a5c9-4dae-93cf-a5ddb733656a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:22.458010 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c477522f-a5c9-4dae-93cf-a5ddb733656a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:22.458441 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c477522f-a5c9-4dae-93cf-a5ddb733656a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:22.458881 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-c477522f-a5c9-4dae-93cf-a5ddb733656a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lazy-loading 'fault' on Instance uuid f0e476ca-b4b7-4537-bfca-2c66b7246c3e {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:02:22.505464 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-c477522f-a5c9-4dae-93cf-a5ddb733656a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:22.514532 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-c477522f-a5c9-4dae-93cf-a5ddb733656a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 200 len: 1327 microversion: 2.1 time: 0.104111 Aug 26 16:02:22.515153 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 450/882] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:22 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 1327 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:22.589315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-4ad76c7c-f2f9-4282-b937-faa5cbd65fdf tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:22.592606 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-4ad76c7c-f2f9-4282-b937-faa5cbd65fdf tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:22.597579 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ad76c7c-f2f9-4282-b937-faa5cbd65fdf tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:22.598063 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ad76c7c-f2f9-4282-b937-faa5cbd65fdf tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:22.598510 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ad76c7c-f2f9-4282-b937-faa5cbd65fdf tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:22.599287 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ad76c7c-f2f9-4282-b937-faa5cbd65fdf tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:22.599725 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ad76c7c-f2f9-4282-b937-faa5cbd65fdf tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:22.600137 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ad76c7c-f2f9-4282-b937-faa5cbd65fdf tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:22.729696 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-4ad76c7c-f2f9-4282-b937-faa5cbd65fdf tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:22.738172 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-4ad76c7c-f2f9-4282-b937-faa5cbd65fdf tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:22.739634 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-4ad76c7c-f2f9-4282-b937-faa5cbd65fdf tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:22.740788 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-4ad76c7c-f2f9-4282-b937-faa5cbd65fdf tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1600 microversion: 2.20 time: 0.155562 Aug 26 16:02:22.741521 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 433/883] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:02:22 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:02:22.763690 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-f76c3a82-ea91-425e-841a-d337ec9889ce tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:22.764185 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-f76c3a82-ea91-425e-841a-d337ec9889ce tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:22.770241 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f76c3a82-ea91-425e-841a-d337ec9889ce tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:22.780490 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f76c3a82-ea91-425e-841a-d337ec9889ce tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:22.780490 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f76c3a82-ea91-425e-841a-d337ec9889ce tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:22.780490 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f76c3a82-ea91-425e-841a-d337ec9889ce tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:22.780490 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f76c3a82-ea91-425e-841a-d337ec9889ce tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:22.780894 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f76c3a82-ea91-425e-841a-d337ec9889ce tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:22.852694 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-f76c3a82-ea91-425e-841a-d337ec9889ce tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093888 Aug 26 16:02:22.853343 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 451/884] 10.222.0.94 () {60 vars in 1316 bytes} [Fri Aug 26 16:02:22 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 16:02:23.536987 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ebdf1693-f9f1-4f57-94cc-4017183d9a33 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:23.537860 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ebdf1693-f9f1-4f57-94cc-4017183d9a33 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:23.544947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebdf1693-f9f1-4f57-94cc-4017183d9a33 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:23.545461 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebdf1693-f9f1-4f57-94cc-4017183d9a33 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:23.546023 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebdf1693-f9f1-4f57-94cc-4017183d9a33 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:23.547185 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebdf1693-f9f1-4f57-94cc-4017183d9a33 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:23.547938 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebdf1693-f9f1-4f57-94cc-4017183d9a33 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:23.548567 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebdf1693-f9f1-4f57-94cc-4017183d9a33 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:23.569297 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-ebdf1693-f9f1-4f57-94cc-4017183d9a33 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] HTTP exception thrown: Instance f0e476ca-b4b7-4537-bfca-2c66b7246c3e could not be found. Aug 26 16:02:23.571307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ebdf1693-f9f1-4f57-94cc-4017183d9a33 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Request method failure captured: Aug 26 16:02:23.571307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e HTTP/1.1 Aug 26 16:02:23.571307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 16:02:23.571307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 16:02:23.571307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 16:02:23.571307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 0 Aug 26 16:02:23.571307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 16:02:23.571307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 16:02:23.571307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 16:02:23.571307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 16:02:23.571307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO0-uZaz_yI8Fg49dle3FpYUy1aJ0NnJxpD4O_IzcLsXjBlx-RJAMTxN5SJE7qQ5dMQ_t19b4V47Xy7w3YZjwfMxBPUM9w64mwEA_HXhitBdZDc4m_jadz8TKAx7O7WpinSOa0TLZUo_YeVpTFQpEDv2Sgn55PqSQsUwV_NAHhnYzUs Aug 26 16:02:23.571307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 16:02:23.571307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 16:02:23.571307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 16:02:23.571307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 16:02:23.571307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 16:02:23.571307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 16:02:23.571307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: 8c69c9fb12124d72954b8ab7ad024175 Aug 26 16:02:23.571307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-AttachVolumeTestJSON-1188349192 Aug 26 16:02:23.571307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 16:02:23.571307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 16:02:23.573005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/8c69c9fb12124d72954b8ab7ad024175"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/8c69c9fb12124d72954b8ab7ad024175"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/8c69c9fb12124d72954b8ab7ad024175"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_8c69c9fb12124d72954b8ab7ad024175", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:02:23.573005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-AttachVolumeTestJSON-1188349192 Aug 26 16:02:23.573005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: 8c69c9fb12124d72954b8ab7ad024175 Aug 26 16:02:23.573005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1188349192 Aug 26 16:02:23.573005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-AttachVolumeTestJSON-1188349192-project Aug 26 16:02:23.573005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 16:02:23.573005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 16:02:23.573005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: 7069a9b54a3245b3ab9671730344e6d3 Aug 26 16:02:23.573005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-AttachVolumeTestJSON-1188349192-project Aug 26 16:02:23.573005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: > Aug 26 16:02:23.573005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Instance f0e476ca-b4b7-4537-bfca-2c66b7246c3e could not be found. Aug 26 16:02:23.573005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'id': 'f0e476ca-b4b7-4537-bfca-2c66b7246c3e'} Aug 26 16:02:23.574262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:02:23.574262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:02:23.574262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:02:23.574262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:02:23.574262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:02:23.574262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:02:23.574262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:02:23.574262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:02:23.574262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:02:23.574262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:02:23.574262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0e476ca-b4b7-4537-bfca-2c66b7246c3e could not be found. Aug 26 16:02:23.574262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:02:23.574262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:02:23.574262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:02:23.574262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:02:23.574262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:02:23.574262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:02:23.574262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:02:23.574262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:02:23.574262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:02:23.576201 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:02:23.576201 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:02:23.576201 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:02:23.576201 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:02:23.576201 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:02:23.576201 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:02:23.576201 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:02:23.576201 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0e476ca-b4b7-4537-bfca-2c66b7246c3e could not be found. Aug 26 16:02:23.576201 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:02:23.576201 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:02:23.576201 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:02:23.576201 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:02:23.576201 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:02:23.576201 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:02:23.576201 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:02:23.576201 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:02:23.576201 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0e476ca-b4b7-4537-bfca-2c66b7246c3e could not be found. Aug 26 16:02:23.576201 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:02:23.577466 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ebdf1693-f9f1-4f57-94cc-4017183d9a33 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Returning 404 to user: Instance f0e476ca-b4b7-4537-bfca-2c66b7246c3e could not be found. {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:02:23.577466 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ebdf1693-f9f1-4f57-94cc-4017183d9a33 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 404 len: 111 microversion: 2.1 time: 0.039744 Aug 26 16:02:23.577466 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 434/885] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:23 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:02:23.583501 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-18f4d5b0-43e9-48c6-83cd-38409b117af4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '.version_select at 0x7f15dcddcd30>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:23.696628 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-18f4d5b0-43e9-48c6-83cd-38409b117af4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-620682017" status: 202 len: 0 microversion: 2.1 time: 0.116576 Aug 26 16:02:23.705549 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 452/886] 10.222.0.94 () {58 vars in 1218 bytes} [Fri Aug 26 16:02:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-620682017 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 16:02:23.914862 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-9b618661-74e5-447b-8b00-5b279a5acd60 req-1625aa9b-1255-4f9f-ba7a-2df3568d0276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fc0c879-6083-414b-b6ee-2046538f526f", "tag": "5921e1e6-5379-4181-b413-94122520d6d1"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:23.915700 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-e5868524-4e94-4ccb-a3ad-616279e7d6b3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d203491d-c486-4c20-8d92-3b93ef451322"}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:23.919295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-e5868524-4e94-4ccb-a3ad-616279e7d6b3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:23.930331 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e5868524-4e94-4ccb-a3ad-616279e7d6b3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:23.931479 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e5868524-4e94-4ccb-a3ad-616279e7d6b3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:23.931966 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e5868524-4e94-4ccb-a3ad-616279e7d6b3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:23.932687 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e5868524-4e94-4ccb-a3ad-616279e7d6b3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:23.933142 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e5868524-4e94-4ccb-a3ad-616279e7d6b3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:23.933570 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e5868524-4e94-4ccb-a3ad-616279e7d6b3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:23.936550 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-9b618661-74e5-447b-8b00-5b279a5acd60 req-1625aa9b-1255-4f9f-ba7a-2df3568d0276 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:23.939133 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-9b618661-74e5-447b-8b00-5b279a5acd60 req-1625aa9b-1255-4f9f-ba7a-2df3568d0276 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:23.939133 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-9b618661-74e5-447b-8b00-5b279a5acd60 req-1625aa9b-1255-4f9f-ba7a-2df3568d0276 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:23.970839 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-9b618661-74e5-447b-8b00-5b279a5acd60 req-1625aa9b-1255-4f9f-ba7a-2df3568d0276 service nova] Creating event network-changed:5921e1e6-5379-4181-b413-94122520d6d1 for instance 3fc0c879-6083-414b-b6ee-2046538f526f on hv-cinder-85144 Aug 26 16:02:23.983662 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-9b618661-74e5-447b-8b00-5b279a5acd60 req-1625aa9b-1255-4f9f-ba7a-2df3568d0276 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072346 Aug 26 16:02:23.984274 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 435/887] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:02:24.819032 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-3855d3b7-5ae0-45a6-9649-e785f1bddf63 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Action: 'create', calling method: .version_select at 0x7f15d9540b80>, body: {"keypair": {"name": "tempest-keypair-1101648721", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIu1tDhJskGykJFw5wjFSKHXu8zFxQO7HBC+cMCitT/KhZuwUwCH0f4r7D6TIGoKyV5OTV6RtTIsFjgWtpEU4x6iNOckAvPEtR1K36TipVaIfhw4gG5gMNuCpZaqWS7GA=="}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:24.835243 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-3855d3b7-5ae0-45a6-9649-e785f1bddf63 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Getting quotas for project 8c69c9fb12124d72954b8ab7ad024175. Resources: {'key_pairs'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 16:02:24.839392 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.quota [None req-3855d3b7-5ae0-45a6-9649-e785f1bddf63 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Getting quotas for user 7069a9b54a3245b3ab9671730344e6d3 and project 8c69c9fb12124d72954b8ab7ad024175. Resources: {'key_pairs'} {{(pid=128304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 16:02:24.875132 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-e5868524-4e94-4ccb-a3ad-616279e7d6b3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "POST /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.963115 Aug 26 16:02:24.875849 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 453/888] 10.222.0.94 () {60 vars in 1323 bytes} [Fri Aug 26 16:02:23 2022] POST /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0/os-volume_attachments => generated 194 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:02:24.923702 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-3855d3b7-5ae0-45a6-9649-e785f1bddf63 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.108920 Aug 26 16:02:24.930301 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 436/889] 10.222.0.94 () {60 vars in 1159 bytes} [Fri Aug 26 16:02:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:02:27.287269 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-49165ec9-61df-42d5-b892-07c5adfe6cd4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2119260702", "imageRef": "bcbdbb0c-7335-4427-a636-e2dc730274b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46346453-7c70-4f46-80a8-f812b7507006"}], "security_groups": [{"name": "tempest-securitygroup--1550774511"}], "key_name": "tempest-keypair-1101648721", "user_data": "}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:27.391382 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.network.neutron [None req-49165ec9-61df-42d5-b892-07c5adfe6cd4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] validate_networks() for [('46346453-7c70-4f46-80a8-f812b7507006', None, None, None, None, None)] {{(pid=128305) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 16:02:27.767218 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-49165ec9-61df-42d5-b892-07c5adfe6cd4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Flavor limits 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 16:02:27.767640 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-49165ec9-61df-42d5-b892-07c5adfe6cd4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Image limits 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 16:02:27.768113 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-49165ec9-61df-42d5-b892-07c5adfe6cd4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Flavor pref 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 16:02:27.768540 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-49165ec9-61df-42d5-b892-07c5adfe6cd4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Image pref 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 16:02:27.768960 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-49165ec9-61df-42d5-b892-07c5adfe6cd4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 16:02:27.777894 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-49165ec9-61df-42d5-b892-07c5adfe6cd4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:27.778543 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-49165ec9-61df-42d5-b892-07c5adfe6cd4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:27.779013 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-49165ec9-61df-42d5-b892-07c5adfe6cd4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:27.779748 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-49165ec9-61df-42d5-b892-07c5adfe6cd4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:27.780208 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-49165ec9-61df-42d5-b892-07c5adfe6cd4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:27.780640 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-49165ec9-61df-42d5-b892-07c5adfe6cd4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:27.797842 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-49165ec9-61df-42d5-b892-07c5adfe6cd4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Getting quotas for project 8c69c9fb12124d72954b8ab7ad024175. Resources: {'instances', 'ram', 'cores'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 16:02:27.801871 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-49165ec9-61df-42d5-b892-07c5adfe6cd4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Getting quotas for user 7069a9b54a3245b3ab9671730344e6d3 and project 8c69c9fb12124d72954b8ab7ad024175. Resources: {'instances', 'ram', 'cores'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 16:02:27.813341 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-49165ec9-61df-42d5-b892-07c5adfe6cd4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Going to run 1 instances... {{(pid=128305) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 16:02:27.815718 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-49165ec9-61df-42d5-b892-07c5adfe6cd4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bcbdbb0c-7335-4427-a636-e2dc730274b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128305) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 16:02:27.951892 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-49165ec9-61df-42d5-b892-07c5adfe6cd4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.669085 Aug 26 16:02:27.952485 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 454/890] 10.222.0.94 () {60 vars in 1147 bytes} [Fri Aug 26 16:02:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 16:02:27.964096 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-b7b3528c-90b4-4673-a62c-3a721e1e2806 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:27.964847 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-b7b3528c-90b4-4673-a62c-3a721e1e2806 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:28.023833 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-b7b3528c-90b4-4673-a62c-3a721e1e2806 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:28.031740 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-b7b3528c-90b4-4673-a62c-3a721e1e2806 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1238 microversion: 2.1 time: 0.072247 Aug 26 16:02:28.032319 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 437/891] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:27 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:29.053492 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-5ff6628a-5c91-41d4-bf84-e8f3537e68c1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:29.054103 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-5ff6628a-5c91-41d4-bf84-e8f3537e68c1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:29.062148 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5ff6628a-5c91-41d4-bf84-e8f3537e68c1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:29.063586 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5ff6628a-5c91-41d4-bf84-e8f3537e68c1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:29.063586 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5ff6628a-5c91-41d4-bf84-e8f3537e68c1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:29.063875 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5ff6628a-5c91-41d4-bf84-e8f3537e68c1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:29.064322 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5ff6628a-5c91-41d4-bf84-e8f3537e68c1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:29.064740 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5ff6628a-5c91-41d4-bf84-e8f3537e68c1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:29.129518 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-5ff6628a-5c91-41d4-bf84-e8f3537e68c1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:29.139853 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-5ff6628a-5c91-41d4-bf84-e8f3537e68c1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1242 microversion: 2.1 time: 0.090845 Aug 26 16:02:29.140757 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 455/892] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:29 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:29.963211 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f6a6313e-4f1f-4806-a708-0f9ad92c8b8b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:29.963741 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-f6a6313e-4f1f-4806-a708-0f9ad92c8b8b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:29.971317 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f6a6313e-4f1f-4806-a708-0f9ad92c8b8b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:29.971798 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f6a6313e-4f1f-4806-a708-0f9ad92c8b8b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:29.972237 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f6a6313e-4f1f-4806-a708-0f9ad92c8b8b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:29.972930 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f6a6313e-4f1f-4806-a708-0f9ad92c8b8b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:29.973394 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f6a6313e-4f1f-4806-a708-0f9ad92c8b8b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:29.973821 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f6a6313e-4f1f-4806-a708-0f9ad92c8b8b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:30.059193 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.objects.instance [None req-f6a6313e-4f1f-4806-a708-0f9ad92c8b8b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lazy-loading 'services' on Instance uuid 842d5015-aa0d-46a5-8162-7201b4277653 {{(pid=128304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:02:30.160977 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-6868ff2d-8a27-4916-b4e9-7eb1b9d0c6d9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:30.161544 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-6868ff2d-8a27-4916-b4e9-7eb1b9d0c6d9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:30.168246 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6868ff2d-8a27-4916-b4e9-7eb1b9d0c6d9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:30.168727 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6868ff2d-8a27-4916-b4e9-7eb1b9d0c6d9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:30.169504 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6868ff2d-8a27-4916-b4e9-7eb1b9d0c6d9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:30.170404 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6868ff2d-8a27-4916-b4e9-7eb1b9d0c6d9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:30.170861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6868ff2d-8a27-4916-b4e9-7eb1b9d0c6d9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:30.171335 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6868ff2d-8a27-4916-b4e9-7eb1b9d0c6d9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:30.252353 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-6868ff2d-8a27-4916-b4e9-7eb1b9d0c6d9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:30.260495 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-6868ff2d-8a27-4916-b4e9-7eb1b9d0c6d9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1290 microversion: 2.1 time: 0.103590 Aug 26 16:02:30.263133 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 456/893] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:30 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1290 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:02:30.289461 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-f6a6313e-4f1f-4806-a708-0f9ad92c8b8b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "DELETE /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653/os-volume_attachments/7c088d23-850b-48a9-94dc-d0ef2c0108f5" status: 202 len: 0 microversion: 2.1 time: 0.330703 Aug 26 16:02:30.290035 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 438/894] 10.222.0.94 () {58 vars in 1416 bytes} [Fri Aug 26 16:02:29 2022] DELETE /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653/os-volume_attachments/7c088d23-850b-48a9-94dc-d0ef2c0108f5 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 16:02:30.298396 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-5a1ab6be-6800-4a7b-8569-184a364c7b00 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:30.300754 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-5a1ab6be-6800-4a7b-8569-184a364c7b00 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:30.306819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5a1ab6be-6800-4a7b-8569-184a364c7b00 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:30.307345 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5a1ab6be-6800-4a7b-8569-184a364c7b00 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:30.307782 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5a1ab6be-6800-4a7b-8569-184a364c7b00 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:30.308475 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5a1ab6be-6800-4a7b-8569-184a364c7b00 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:30.308932 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5a1ab6be-6800-4a7b-8569-184a364c7b00 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:30.309362 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5a1ab6be-6800-4a7b-8569-184a364c7b00 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:30.339932 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-5a1ab6be-6800-4a7b-8569-184a364c7b00 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045521 Aug 26 16:02:30.340477 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 457/895] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:02:30 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:02:31.279471 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell0:SELECT=2 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:31.283636 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-cf29b0b3-6e79-4250-a63a-26b556275c18 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:31.284334 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-cf29b0b3-6e79-4250-a63a-26b556275c18 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:31.290492 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cf29b0b3-6e79-4250-a63a-26b556275c18 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:31.291004 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cf29b0b3-6e79-4250-a63a-26b556275c18 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:31.291610 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cf29b0b3-6e79-4250-a63a-26b556275c18 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:31.292461 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cf29b0b3-6e79-4250-a63a-26b556275c18 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:31.292914 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cf29b0b3-6e79-4250-a63a-26b556275c18 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:31.293336 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cf29b0b3-6e79-4250-a63a-26b556275c18 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:31.352597 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-2c0bb878-25ec-435d-974c-7cd1716989c8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:31.355189 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-2c0bb878-25ec-435d-974c-7cd1716989c8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:31.356804 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-cf29b0b3-6e79-4250-a63a-26b556275c18 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:31.362399 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2c0bb878-25ec-435d-974c-7cd1716989c8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:31.362985 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2c0bb878-25ec-435d-974c-7cd1716989c8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:31.363485 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2c0bb878-25ec-435d-974c-7cd1716989c8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:31.364246 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2c0bb878-25ec-435d-974c-7cd1716989c8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:31.364786 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2c0bb878-25ec-435d-974c-7cd1716989c8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:31.365230 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-cf29b0b3-6e79-4250-a63a-26b556275c18 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1308 microversion: 2.1 time: 0.087197 Aug 26 16:02:31.365331 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2c0bb878-25ec-435d-974c-7cd1716989c8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:31.365805 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 439/896] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:31 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1308 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:31.395836 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-2c0bb878-25ec-435d-974c-7cd1716989c8 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047417 Aug 26 16:02:31.396397 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 458/897] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:02:31 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:02:32.387664 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-fe4a338d-1205-4df3-8068-a1dcf688e0e6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:32.389604 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-fe4a338d-1205-4df3-8068-a1dcf688e0e6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:32.396590 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fe4a338d-1205-4df3-8068-a1dcf688e0e6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:32.396763 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fe4a338d-1205-4df3-8068-a1dcf688e0e6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:32.397198 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fe4a338d-1205-4df3-8068-a1dcf688e0e6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:32.398053 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fe4a338d-1205-4df3-8068-a1dcf688e0e6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:32.398506 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fe4a338d-1205-4df3-8068-a1dcf688e0e6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:32.398946 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fe4a338d-1205-4df3-8068-a1dcf688e0e6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:32.415842 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-bd921a8c-28f1-4ffa-b2e5-abda2d12da0c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:32.418385 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-bd921a8c-28f1-4ffa-b2e5-abda2d12da0c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:32.425782 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bd921a8c-28f1-4ffa-b2e5-abda2d12da0c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:32.426383 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bd921a8c-28f1-4ffa-b2e5-abda2d12da0c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:32.426961 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bd921a8c-28f1-4ffa-b2e5-abda2d12da0c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:32.427851 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bd921a8c-28f1-4ffa-b2e5-abda2d12da0c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:32.428411 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bd921a8c-28f1-4ffa-b2e5-abda2d12da0c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:32.428936 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bd921a8c-28f1-4ffa-b2e5-abda2d12da0c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:32.433183 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:32.462432 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-bd921a8c-28f1-4ffa-b2e5-abda2d12da0c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050559 Aug 26 16:02:32.463031 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 459/898] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:02:32 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:02:32.533449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-fe4a338d-1205-4df3-8068-a1dcf688e0e6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:32.541558 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-fe4a338d-1205-4df3-8068-a1dcf688e0e6 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1364 microversion: 2.1 time: 0.158190 Aug 26 16:02:32.542222 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 440/899] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:32 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:33.476642 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-089f295e-c24b-4f76-abd9-aaa6d280708b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:33.478774 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-089f295e-c24b-4f76-abd9-aaa6d280708b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:33.487432 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-089f295e-c24b-4f76-abd9-aaa6d280708b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:33.487907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-089f295e-c24b-4f76-abd9-aaa6d280708b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:33.488340 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-089f295e-c24b-4f76-abd9-aaa6d280708b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:33.489027 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-089f295e-c24b-4f76-abd9-aaa6d280708b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:33.489475 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-089f295e-c24b-4f76-abd9-aaa6d280708b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:33.489912 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-089f295e-c24b-4f76-abd9-aaa6d280708b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:33.519144 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-089f295e-c24b-4f76-abd9-aaa6d280708b tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046793 Aug 26 16:02:33.519696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 460/900] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:02:33 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:02:33.563556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-8768e275-3d5a-47ba-91ff-f16ed5733a4b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:33.564172 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-8768e275-3d5a-47ba-91ff-f16ed5733a4b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:33.571271 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8768e275-3d5a-47ba-91ff-f16ed5733a4b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:33.572462 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8768e275-3d5a-47ba-91ff-f16ed5733a4b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:33.572462 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8768e275-3d5a-47ba-91ff-f16ed5733a4b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:33.572966 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8768e275-3d5a-47ba-91ff-f16ed5733a4b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:33.573425 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8768e275-3d5a-47ba-91ff-f16ed5733a4b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:33.573905 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8768e275-3d5a-47ba-91ff-f16ed5733a4b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:33.713579 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-8768e275-3d5a-47ba-91ff-f16ed5733a4b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:33.722243 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-8768e275-3d5a-47ba-91ff-f16ed5733a4b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1364 microversion: 2.1 time: 0.163371 Aug 26 16:02:33.722863 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 441/901] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:33 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:33.967907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-fc017be2-0019-4014-be6b-28997c8d42cc req-dd8e5b43-71c6-4636-81ee-149e47d77d58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c945896-ccdd-42e4-a22c-b21e453512ff", "tag": "6125da79-8738-4060-8d3d-5484c0e0a462"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:33.977823 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-fc017be2-0019-4014-be6b-28997c8d42cc req-dd8e5b43-71c6-4636-81ee-149e47d77d58 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:33.978358 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-fc017be2-0019-4014-be6b-28997c8d42cc req-dd8e5b43-71c6-4636-81ee-149e47d77d58 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:33.978784 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-fc017be2-0019-4014-be6b-28997c8d42cc req-dd8e5b43-71c6-4636-81ee-149e47d77d58 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:33.993679 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-fc017be2-0019-4014-be6b-28997c8d42cc req-dd8e5b43-71c6-4636-81ee-149e47d77d58 service nova] Creating event network-changed:6125da79-8738-4060-8d3d-5484c0e0a462 for instance 4c945896-ccdd-42e4-a22c-b21e453512ff on hv-cinder-85144 Aug 26 16:02:33.996604 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-fc017be2-0019-4014-be6b-28997c8d42cc req-dd8e5b43-71c6-4636-81ee-149e47d77d58 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033768 Aug 26 16:02:33.997296 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 461/902] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:02:34.533287 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-fa96168b-2e2f-4a61-acbc-470f6f867bca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:34.535781 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-fa96168b-2e2f-4a61-acbc-470f6f867bca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:34.541909 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fa96168b-2e2f-4a61-acbc-470f6f867bca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:34.542414 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fa96168b-2e2f-4a61-acbc-470f6f867bca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:34.542847 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fa96168b-2e2f-4a61-acbc-470f6f867bca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:34.543569 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fa96168b-2e2f-4a61-acbc-470f6f867bca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:34.544045 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fa96168b-2e2f-4a61-acbc-470f6f867bca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:34.544464 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fa96168b-2e2f-4a61-acbc-470f6f867bca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:34.580437 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-fa96168b-2e2f-4a61-acbc-470f6f867bca tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052403 Aug 26 16:02:34.581008 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 442/903] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:02:34 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:02:34.610585 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-fc1e011b-2e1d-4799-a0e3-14d3f8feb8c0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:34.611316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-fc1e011b-2e1d-4799-a0e3-14d3f8feb8c0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:34.618533 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fc1e011b-2e1d-4799-a0e3-14d3f8feb8c0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:34.619041 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fc1e011b-2e1d-4799-a0e3-14d3f8feb8c0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:34.619474 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fc1e011b-2e1d-4799-a0e3-14d3f8feb8c0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:34.620164 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fc1e011b-2e1d-4799-a0e3-14d3f8feb8c0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:34.620612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fc1e011b-2e1d-4799-a0e3-14d3f8feb8c0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:34.621032 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fc1e011b-2e1d-4799-a0e3-14d3f8feb8c0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:34.744513 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-6e8d08db-aa00-442f-a7b2-7d58dbbd788d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:34.745755 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-6e8d08db-aa00-442f-a7b2-7d58dbbd788d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:34.753601 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6e8d08db-aa00-442f-a7b2-7d58dbbd788d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:34.754118 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6e8d08db-aa00-442f-a7b2-7d58dbbd788d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:34.754553 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6e8d08db-aa00-442f-a7b2-7d58dbbd788d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:34.755339 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6e8d08db-aa00-442f-a7b2-7d58dbbd788d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:34.755795 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6e8d08db-aa00-442f-a7b2-7d58dbbd788d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:34.756222 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6e8d08db-aa00-442f-a7b2-7d58dbbd788d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:34.759032 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-fc1e011b-2e1d-4799-a0e3-14d3f8feb8c0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:34.772355 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-fc1e011b-2e1d-4799-a0e3-14d3f8feb8c0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1595 microversion: 2.1 time: 0.166240 Aug 26 16:02:34.787481 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 462/904] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:34 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1595 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:34.907220 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-6e8d08db-aa00-442f-a7b2-7d58dbbd788d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:34.910066 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:34.916953 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-6e8d08db-aa00-442f-a7b2-7d58dbbd788d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1364 microversion: 2.1 time: 0.176971 Aug 26 16:02:34.917841 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 443/905] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:34 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:35.593275 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-501b618e-10c9-4e67-9e94-b0b027d234e3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:35.595631 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-501b618e-10c9-4e67-9e94-b0b027d234e3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:35.601524 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-501b618e-10c9-4e67-9e94-b0b027d234e3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:35.601998 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-501b618e-10c9-4e67-9e94-b0b027d234e3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:35.602427 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-501b618e-10c9-4e67-9e94-b0b027d234e3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:35.603151 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-501b618e-10c9-4e67-9e94-b0b027d234e3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:35.603628 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-501b618e-10c9-4e67-9e94-b0b027d234e3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:35.604047 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-501b618e-10c9-4e67-9e94-b0b027d234e3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:35.633552 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-501b618e-10c9-4e67-9e94-b0b027d234e3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044811 Aug 26 16:02:35.634199 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 463/906] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:02:35 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 16:02:35.714801 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-d08beba3-ca09-4d46-9d14-3dd7845484c3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:35.715463 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-d08beba3-ca09-4d46-9d14-3dd7845484c3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:35.723130 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d08beba3-ca09-4d46-9d14-3dd7845484c3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:35.723625 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d08beba3-ca09-4d46-9d14-3dd7845484c3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:35.724057 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d08beba3-ca09-4d46-9d14-3dd7845484c3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:35.724758 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d08beba3-ca09-4d46-9d14-3dd7845484c3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:35.725211 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d08beba3-ca09-4d46-9d14-3dd7845484c3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:35.725667 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d08beba3-ca09-4d46-9d14-3dd7845484c3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:35.751639 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-d08beba3-ca09-4d46-9d14-3dd7845484c3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Going to try to terminate instance {{(pid=128304) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 16:02:35.938220 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-60f10169-ecb4-4a2b-a060-c729d1c40816 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:35.938900 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-60f10169-ecb4-4a2b-a060-c729d1c40816 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:35.944683 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-60f10169-ecb4-4a2b-a060-c729d1c40816 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:35.945707 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-60f10169-ecb4-4a2b-a060-c729d1c40816 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:35.946144 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-60f10169-ecb4-4a2b-a060-c729d1c40816 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:35.946990 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-60f10169-ecb4-4a2b-a060-c729d1c40816 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:35.947477 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-60f10169-ecb4-4a2b-a060-c729d1c40816 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:35.947903 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-60f10169-ecb4-4a2b-a060-c729d1c40816 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:36.074982 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-d08beba3-ca09-4d46-9d14-3dd7845484c3 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "DELETE /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 204 len: 0 microversion: 2.1 time: 0.363979 Aug 26 16:02:36.078432 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 444/907] 10.222.0.94 () {58 vars in 1239 bytes} [Fri Aug 26 16:02:35 2022] DELETE /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 16:02:36.091562 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-906d1bfc-a6f8-44d0-9ed5-d3b6a448a291 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:36.092258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-906d1bfc-a6f8-44d0-9ed5-d3b6a448a291 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:36.098284 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-906d1bfc-a6f8-44d0-9ed5-d3b6a448a291 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:36.098770 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-906d1bfc-a6f8-44d0-9ed5-d3b6a448a291 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:36.099247 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-906d1bfc-a6f8-44d0-9ed5-d3b6a448a291 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:36.099982 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-906d1bfc-a6f8-44d0-9ed5-d3b6a448a291 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:36.100538 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-906d1bfc-a6f8-44d0-9ed5-d3b6a448a291 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:36.100850 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-906d1bfc-a6f8-44d0-9ed5-d3b6a448a291 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:36.185058 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-60f10169-ecb4-4a2b-a060-c729d1c40816 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:36.194263 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-60f10169-ecb4-4a2b-a060-c729d1c40816 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1364 microversion: 2.1 time: 0.260482 Aug 26 16:02:36.194749 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 464/908] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:35 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1364 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:02:36.321245 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-906d1bfc-a6f8-44d0-9ed5-d3b6a448a291 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:36.329184 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-906d1bfc-a6f8-44d0-9ed5-d3b6a448a291 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1689 microversion: 2.1 time: 0.243920 Aug 26 16:02:36.333002 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 445/909] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:36 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1689 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:02:37.020574 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-6d6b9234-5448-4e8a-9cbd-afb78c0963b2 req-8fc386ec-7f6f-4de9-a646-7a1114746026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d2e527f-8238-448e-bad8-72e6223612f0", "tag": "9fafeb43-ac51-4d27-a7ea-6b8e26f031a0"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:37.032843 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-6d6b9234-5448-4e8a-9cbd-afb78c0963b2 req-8fc386ec-7f6f-4de9-a646-7a1114746026 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:37.033327 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-6d6b9234-5448-4e8a-9cbd-afb78c0963b2 req-8fc386ec-7f6f-4de9-a646-7a1114746026 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:37.033756 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-6d6b9234-5448-4e8a-9cbd-afb78c0963b2 req-8fc386ec-7f6f-4de9-a646-7a1114746026 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:37.046511 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-6d6b9234-5448-4e8a-9cbd-afb78c0963b2 req-8fc386ec-7f6f-4de9-a646-7a1114746026 service nova] Creating event network-changed:9fafeb43-ac51-4d27-a7ea-6b8e26f031a0 for instance 6d2e527f-8238-448e-bad8-72e6223612f0 on hv-cinder-85144 Aug 26 16:02:37.051483 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-6d6b9234-5448-4e8a-9cbd-afb78c0963b2 req-8fc386ec-7f6f-4de9-a646-7a1114746026 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034848 Aug 26 16:02:37.052070 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 465/910] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:02:37.216186 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-aa872174-ed29-4670-81af-f539028884f9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:37.216803 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-aa872174-ed29-4670-81af-f539028884f9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:37.224046 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-aa872174-ed29-4670-81af-f539028884f9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:37.224797 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-aa872174-ed29-4670-81af-f539028884f9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:37.225301 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-aa872174-ed29-4670-81af-f539028884f9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:37.226135 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-aa872174-ed29-4670-81af-f539028884f9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:37.226593 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-aa872174-ed29-4670-81af-f539028884f9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:37.227240 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-aa872174-ed29-4670-81af-f539028884f9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:37.354213 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-e728de48-1ea2-45bb-b0ec-ccf855534547 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:37.356337 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-e728de48-1ea2-45bb-b0ec-ccf855534547 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:37.364738 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e728de48-1ea2-45bb-b0ec-ccf855534547 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:37.374370 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e728de48-1ea2-45bb-b0ec-ccf855534547 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:37.374370 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e728de48-1ea2-45bb-b0ec-ccf855534547 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:37.374370 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e728de48-1ea2-45bb-b0ec-ccf855534547 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:37.374370 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e728de48-1ea2-45bb-b0ec-ccf855534547 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:37.375188 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e728de48-1ea2-45bb-b0ec-ccf855534547 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:37.713691 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-aa872174-ed29-4670-81af-f539028884f9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:37.717503 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-e728de48-1ea2-45bb-b0ec-ccf855534547 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:37.724204 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-aa872174-ed29-4670-81af-f539028884f9 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1364 microversion: 2.1 time: 0.511750 Aug 26 16:02:37.725818 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-e728de48-1ea2-45bb-b0ec-ccf855534547 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1689 microversion: 2.1 time: 0.379163 Aug 26 16:02:37.735093 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 466/911] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:37 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1689 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:02:37.735429 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 446/912] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:37 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1364 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:38.748406 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-10670645-0a05-4a70-9f02-3aa84015a27f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:38.749716 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-b860e1b1-50d3-4378-9d92-680799b50281 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:38.750207 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-10670645-0a05-4a70-9f02-3aa84015a27f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:38.750368 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-b860e1b1-50d3-4378-9d92-680799b50281 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:38.751951 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell0:SELECT=2 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:38.752355 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell0:SELECT=6 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:38.752633 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell0:SELECT=6 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:38.753516 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:38.757924 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-10670645-0a05-4a70-9f02-3aa84015a27f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:38.758134 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b860e1b1-50d3-4378-9d92-680799b50281 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:38.758405 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-10670645-0a05-4a70-9f02-3aa84015a27f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:38.758729 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b860e1b1-50d3-4378-9d92-680799b50281 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:38.758845 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-10670645-0a05-4a70-9f02-3aa84015a27f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:38.759185 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b860e1b1-50d3-4378-9d92-680799b50281 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:38.759571 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-10670645-0a05-4a70-9f02-3aa84015a27f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:38.759965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b860e1b1-50d3-4378-9d92-680799b50281 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:38.760069 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-10670645-0a05-4a70-9f02-3aa84015a27f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:38.760411 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-10670645-0a05-4a70-9f02-3aa84015a27f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:38.760510 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b860e1b1-50d3-4378-9d92-680799b50281 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:38.760829 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b860e1b1-50d3-4378-9d92-680799b50281 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:38.975434 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-10670645-0a05-4a70-9f02-3aa84015a27f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:38.983876 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-10670645-0a05-4a70-9f02-3aa84015a27f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1364 microversion: 2.1 time: 0.238476 Aug 26 16:02:38.984455 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 467/913] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:38 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:38.999881 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-b860e1b1-50d3-4378-9d92-680799b50281 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:39.007616 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-b860e1b1-50d3-4378-9d92-680799b50281 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1689 microversion: 2.1 time: 0.262378 Aug 26 16:02:39.008189 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 447/914] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:38 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1689 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:02:39.857503 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-c4854033-101d-47a2-b340-c0b4300245ab req-b894fea9-8d41-4ce1-b94a-e5c0f2f53580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c945896-ccdd-42e4-a22c-b21e453512ff", "name": "network-vif-plugged", "status": "completed", "tag": "6125da79-8738-4060-8d3d-5484c0e0a462"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:39.867120 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-c4854033-101d-47a2-b340-c0b4300245ab req-b894fea9-8d41-4ce1-b94a-e5c0f2f53580 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:39.867592 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-c4854033-101d-47a2-b340-c0b4300245ab req-b894fea9-8d41-4ce1-b94a-e5c0f2f53580 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:39.868017 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-c4854033-101d-47a2-b340-c0b4300245ab req-b894fea9-8d41-4ce1-b94a-e5c0f2f53580 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:39.879516 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-c4854033-101d-47a2-b340-c0b4300245ab req-b894fea9-8d41-4ce1-b94a-e5c0f2f53580 service nova] Creating event network-vif-plugged:6125da79-8738-4060-8d3d-5484c0e0a462 for instance 4c945896-ccdd-42e4-a22c-b21e453512ff on hv-cinder-85144 Aug 26 16:02:39.884206 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-c4854033-101d-47a2-b340-c0b4300245ab req-b894fea9-8d41-4ce1-b94a-e5c0f2f53580 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089777 Aug 26 16:02:39.885127 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 468/915] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:02:40.005634 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ee98b70e-7d75-423c-8a1d-55246b354f40 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:40.006270 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ee98b70e-7d75-423c-8a1d-55246b354f40 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:40.013261 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ee98b70e-7d75-423c-8a1d-55246b354f40 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:40.013737 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ee98b70e-7d75-423c-8a1d-55246b354f40 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:40.014166 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ee98b70e-7d75-423c-8a1d-55246b354f40 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:40.015598 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ee98b70e-7d75-423c-8a1d-55246b354f40 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:40.016056 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ee98b70e-7d75-423c-8a1d-55246b354f40 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:40.016476 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ee98b70e-7d75-423c-8a1d-55246b354f40 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:40.030108 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-db91c281-b2d3-4969-a112-54b652ada92f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:40.031011 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-db91c281-b2d3-4969-a112-54b652ada92f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:40.037281 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-db91c281-b2d3-4969-a112-54b652ada92f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:40.037764 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-db91c281-b2d3-4969-a112-54b652ada92f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:40.038287 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-db91c281-b2d3-4969-a112-54b652ada92f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:40.039209 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-db91c281-b2d3-4969-a112-54b652ada92f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:40.039837 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-db91c281-b2d3-4969-a112-54b652ada92f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:40.040263 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-db91c281-b2d3-4969-a112-54b652ada92f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:40.215701 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-ee98b70e-7d75-423c-8a1d-55246b354f40 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:40.223350 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ee98b70e-7d75-423c-8a1d-55246b354f40 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1364 microversion: 2.1 time: 0.221565 Aug 26 16:02:40.223921 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 448/916] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:40 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:40.227032 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-db91c281-b2d3-4969-a112-54b652ada92f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:40.235483 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-87969314-10cf-4ef5-81d4-c183ad11d8ac tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-529809820"}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:40.238624 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-87969314-10cf-4ef5-81d4-c183ad11d8ac tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:40.238763 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-db91c281-b2d3-4969-a112-54b652ada92f tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1689 microversion: 2.1 time: 0.210538 Aug 26 16:02:40.238763 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 469/917] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:40 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1689 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:40.241943 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-87969314-10cf-4ef5-81d4-c183ad11d8ac tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:40.242473 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-87969314-10cf-4ef5-81d4-c183ad11d8ac tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:40.242910 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-87969314-10cf-4ef5-81d4-c183ad11d8ac tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:40.243645 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-87969314-10cf-4ef5-81d4-c183ad11d8ac tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:40.244579 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-87969314-10cf-4ef5-81d4-c183ad11d8ac tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:40.244579 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-87969314-10cf-4ef5-81d4-c183ad11d8ac tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:40.372082 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.network.security_group_api [None req-87969314-10cf-4ef5-81d4-c183ad11d8ac tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Adding security group d3fe6aa2-d26c-4b97-a6b7-c6d591e6d9e4 to port 9fafeb43-ac51-4d27-a7ea-6b8e26f031a0 Aug 26 16:02:40.780305 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-87969314-10cf-4ef5-81d4-c183ad11d8ac tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "POST /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0/action" status: 202 len: 0 microversion: 2.1 time: 0.548501 Aug 26 16:02:40.781151 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 449/918] 10.222.0.94 () {60 vars in 1278 bytes} [Fri Aug 26 16:02:40 2022] POST /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0/action => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 16:02:40.789050 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-f8669679-8ab8-481f-9ed0-eaa7ed0bc3b9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:40.789650 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-f8669679-8ab8-481f-9ed0-eaa7ed0bc3b9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:40.796539 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-3db310cf-ebeb-4217-80d9-28f14f9d22b3 req-94ac9c68-1cb2-40df-b7fa-a12333e2b708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d2e527f-8238-448e-bad8-72e6223612f0", "tag": "9fafeb43-ac51-4d27-a7ea-6b8e26f031a0"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:40.805373 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f8669679-8ab8-481f-9ed0-eaa7ed0bc3b9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:40.805866 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f8669679-8ab8-481f-9ed0-eaa7ed0bc3b9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:40.806428 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f8669679-8ab8-481f-9ed0-eaa7ed0bc3b9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:40.807366 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f8669679-8ab8-481f-9ed0-eaa7ed0bc3b9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:40.807834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f8669679-8ab8-481f-9ed0-eaa7ed0bc3b9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:40.807950 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-3db310cf-ebeb-4217-80d9-28f14f9d22b3 req-94ac9c68-1cb2-40df-b7fa-a12333e2b708 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:40.808261 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f8669679-8ab8-481f-9ed0-eaa7ed0bc3b9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:40.808387 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-3db310cf-ebeb-4217-80d9-28f14f9d22b3 req-94ac9c68-1cb2-40df-b7fa-a12333e2b708 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:40.808763 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-3db310cf-ebeb-4217-80d9-28f14f9d22b3 req-94ac9c68-1cb2-40df-b7fa-a12333e2b708 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:40.821663 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-3db310cf-ebeb-4217-80d9-28f14f9d22b3 req-94ac9c68-1cb2-40df-b7fa-a12333e2b708 service nova] Creating event network-changed:9fafeb43-ac51-4d27-a7ea-6b8e26f031a0 for instance 6d2e527f-8238-448e-bad8-72e6223612f0 on hv-cinder-85144 Aug 26 16:02:40.830250 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-3db310cf-ebeb-4217-80d9-28f14f9d22b3 req-94ac9c68-1cb2-40df-b7fa-a12333e2b708 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037577 Aug 26 16:02:40.831098 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 450/919] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:02:40.955857 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-f8669679-8ab8-481f-9ed0-eaa7ed0bc3b9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:40.964587 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-f8669679-8ab8-481f-9ed0-eaa7ed0bc3b9 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1641 microversion: 2.1 time: 0.179292 Aug 26 16:02:40.965167 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 470/920] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:40 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1641 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:02:41.245239 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-6ae087ea-0e48-4794-b01a-e274aacedf70 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:41.245935 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-6ae087ea-0e48-4794-b01a-e274aacedf70 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:41.254355 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ae087ea-0e48-4794-b01a-e274aacedf70 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:41.255158 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ae087ea-0e48-4794-b01a-e274aacedf70 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:41.255786 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ae087ea-0e48-4794-b01a-e274aacedf70 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:41.257187 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ae087ea-0e48-4794-b01a-e274aacedf70 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:41.257823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ae087ea-0e48-4794-b01a-e274aacedf70 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:41.258413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ae087ea-0e48-4794-b01a-e274aacedf70 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:41.259948 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-24e3ca0a-0e85-4fb4-8961-c58e2ca546cc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:41.260505 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-24e3ca0a-0e85-4fb4-8961-c58e2ca546cc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:41.277470 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-24e3ca0a-0e85-4fb4-8961-c58e2ca546cc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:41.277470 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-24e3ca0a-0e85-4fb4-8961-c58e2ca546cc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:41.277470 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-24e3ca0a-0e85-4fb4-8961-c58e2ca546cc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:41.277470 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-24e3ca0a-0e85-4fb4-8961-c58e2ca546cc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:41.277937 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-24e3ca0a-0e85-4fb4-8961-c58e2ca546cc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:41.277937 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-24e3ca0a-0e85-4fb4-8961-c58e2ca546cc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:41.673920 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-6ae087ea-0e48-4794-b01a-e274aacedf70 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:41.680719 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-24e3ca0a-0e85-4fb4-8961-c58e2ca546cc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:41.682385 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-6ae087ea-0e48-4794-b01a-e274aacedf70 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1364 microversion: 2.1 time: 0.441319 Aug 26 16:02:41.695115 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 451/921] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:41 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1364 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:41.695383 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-24e3ca0a-0e85-4fb4-8961-c58e2ca546cc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1689 microversion: 2.1 time: 0.438670 Aug 26 16:02:41.698084 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 471/922] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:41 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1689 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:02:42.705002 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-9910be7e-2341-4074-9306-59fecc95eb39 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:42.706282 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-9910be7e-2341-4074-9306-59fecc95eb39 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:42.713382 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9910be7e-2341-4074-9306-59fecc95eb39 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:42.717951 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9910be7e-2341-4074-9306-59fecc95eb39 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:42.717951 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9910be7e-2341-4074-9306-59fecc95eb39 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:42.717951 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9910be7e-2341-4074-9306-59fecc95eb39 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:42.717951 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9910be7e-2341-4074-9306-59fecc95eb39 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:42.719110 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9910be7e-2341-4074-9306-59fecc95eb39 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:42.719328 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-fdc48de0-68f9-415f-90e5-36bb98a6bc5c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:42.720195 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-fdc48de0-68f9-415f-90e5-36bb98a6bc5c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:42.727668 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fdc48de0-68f9-415f-90e5-36bb98a6bc5c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:42.728401 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fdc48de0-68f9-415f-90e5-36bb98a6bc5c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:42.729126 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fdc48de0-68f9-415f-90e5-36bb98a6bc5c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:42.730112 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fdc48de0-68f9-415f-90e5-36bb98a6bc5c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:42.730668 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fdc48de0-68f9-415f-90e5-36bb98a6bc5c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:42.731236 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fdc48de0-68f9-415f-90e5-36bb98a6bc5c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:42.855206 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-fdc48de0-68f9-415f-90e5-36bb98a6bc5c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:42.863767 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-fdc48de0-68f9-415f-90e5-36bb98a6bc5c tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1621 microversion: 2.1 time: 0.151847 Aug 26 16:02:42.875359 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 472/923] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:42 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1621 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:42.875359 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-543915d9-78c1-4c31-9af5-378d5fb2a085 req-b6047f33-0d50-42d4-a732-315cd6ac1371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "842d5015-aa0d-46a5-8162-7201b4277653", "name": "network-vif-deleted", "tag": "3b2c5b8a-cb44-484c-9531-c39f763ffef9"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:42.882794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-543915d9-78c1-4c31-9af5-378d5fb2a085 req-b6047f33-0d50-42d4-a732-315cd6ac1371 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:42.883343 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-543915d9-78c1-4c31-9af5-378d5fb2a085 req-b6047f33-0d50-42d4-a732-315cd6ac1371 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:42.883918 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-543915d9-78c1-4c31-9af5-378d5fb2a085 req-b6047f33-0d50-42d4-a732-315cd6ac1371 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:42.902958 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-543915d9-78c1-4c31-9af5-378d5fb2a085 req-b6047f33-0d50-42d4-a732-315cd6ac1371 service nova] Creating event network-vif-deleted:3b2c5b8a-cb44-484c-9531-c39f763ffef9 for instance 842d5015-aa0d-46a5-8162-7201b4277653 on hv-cinder-85144 Aug 26 16:02:42.910727 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-543915d9-78c1-4c31-9af5-378d5fb2a085 req-b6047f33-0d50-42d4-a732-315cd6ac1371 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044349 Aug 26 16:02:42.912099 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 473/924] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:02:43.013901 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-9910be7e-2341-4074-9306-59fecc95eb39 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:43.022683 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-9910be7e-2341-4074-9306-59fecc95eb39 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1364 microversion: 2.1 time: 0.321872 Aug 26 16:02:43.023303 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 452/925] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:42 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1364 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:02:43.889687 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-8ab56d8c-2e2d-4ce4-aa79-20ab56364e4d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:43.890667 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-8ab56d8c-2e2d-4ce4-aa79-20ab56364e4d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:43.896793 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8ab56d8c-2e2d-4ce4-aa79-20ab56364e4d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:43.897337 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8ab56d8c-2e2d-4ce4-aa79-20ab56364e4d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:43.897771 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8ab56d8c-2e2d-4ce4-aa79-20ab56364e4d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:43.898455 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8ab56d8c-2e2d-4ce4-aa79-20ab56364e4d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:43.898902 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8ab56d8c-2e2d-4ce4-aa79-20ab56364e4d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:43.899336 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8ab56d8c-2e2d-4ce4-aa79-20ab56364e4d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:43.930450 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8ab56d8c-2e2d-4ce4-aa79-20ab56364e4d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:43.930940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8ab56d8c-2e2d-4ce4-aa79-20ab56364e4d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:43.931388 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8ab56d8c-2e2d-4ce4-aa79-20ab56364e4d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:43.931829 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-8ab56d8c-2e2d-4ce4-aa79-20ab56364e4d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lazy-loading 'fault' on Instance uuid 842d5015-aa0d-46a5-8162-7201b4277653 {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:02:43.974470 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-8ab56d8c-2e2d-4ce4-aa79-20ab56364e4d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:43.982007 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-8ab56d8c-2e2d-4ce4-aa79-20ab56364e4d tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1335 microversion: 2.1 time: 0.097539 Aug 26 16:02:43.982563 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 474/926] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:43 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1335 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:44.043376 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-76411bfa-6197-4485-ae2b-4c8c840153a2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:44.044084 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-76411bfa-6197-4485-ae2b-4c8c840153a2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:44.050881 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-76411bfa-6197-4485-ae2b-4c8c840153a2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:44.051637 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-76411bfa-6197-4485-ae2b-4c8c840153a2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:44.052082 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-76411bfa-6197-4485-ae2b-4c8c840153a2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:44.052787 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-76411bfa-6197-4485-ae2b-4c8c840153a2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:44.053246 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-76411bfa-6197-4485-ae2b-4c8c840153a2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:44.053677 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-76411bfa-6197-4485-ae2b-4c8c840153a2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:44.284165 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-76411bfa-6197-4485-ae2b-4c8c840153a2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:44.292640 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-76411bfa-6197-4485-ae2b-4c8c840153a2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1549 microversion: 2.1 time: 0.253306 Aug 26 16:02:44.293210 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 453/927] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:44 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1549 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:44.314199 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-c573dddd-b997-4b61-9783-258f272b8d48 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:44.314999 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-c573dddd-b997-4b61-9783-258f272b8d48 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:44.321277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c573dddd-b997-4b61-9783-258f272b8d48 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:44.323614 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c573dddd-b997-4b61-9783-258f272b8d48 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:44.323614 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c573dddd-b997-4b61-9783-258f272b8d48 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:44.323614 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c573dddd-b997-4b61-9783-258f272b8d48 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:44.323614 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c573dddd-b997-4b61-9783-258f272b8d48 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:44.323994 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c573dddd-b997-4b61-9783-258f272b8d48 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:44.413556 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-c573dddd-b997-4b61-9783-258f272b8d48 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103855 Aug 26 16:02:44.414137 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 475/928] 10.222.0.94 () {58 vars in 1275 bytes} [Fri Aug 26 16:02:44 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:02:45.002458 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f15e6749-22ec-4461-a0e3-c63f65e16de1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:45.003022 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-f15e6749-22ec-4461-a0e3-c63f65e16de1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:45.009318 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f15e6749-22ec-4461-a0e3-c63f65e16de1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:45.009956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f15e6749-22ec-4461-a0e3-c63f65e16de1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:45.010239 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f15e6749-22ec-4461-a0e3-c63f65e16de1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:45.010994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f15e6749-22ec-4461-a0e3-c63f65e16de1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:45.011467 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f15e6749-22ec-4461-a0e3-c63f65e16de1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:45.011899 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f15e6749-22ec-4461-a0e3-c63f65e16de1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:45.043817 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f15e6749-22ec-4461-a0e3-c63f65e16de1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:45.044474 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f15e6749-22ec-4461-a0e3-c63f65e16de1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:45.044731 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f15e6749-22ec-4461-a0e3-c63f65e16de1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:45.045181 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.objects.instance [None req-f15e6749-22ec-4461-a0e3-c63f65e16de1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lazy-loading 'fault' on Instance uuid 842d5015-aa0d-46a5-8162-7201b4277653 {{(pid=128304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:02:45.091874 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-f15e6749-22ec-4461-a0e3-c63f65e16de1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:45.100866 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-f15e6749-22ec-4461-a0e3-c63f65e16de1 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 200 len: 1335 microversion: 2.1 time: 0.102473 Aug 26 16:02:45.101440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 454/929] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:44 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 1335 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:45.469513 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-5726654d-4d24-4610-91e6-55bae9477cec req-1e310edb-8b31-455c-97f7-228eac46c2e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c945896-ccdd-42e4-a22c-b21e453512ff", "tag": "6125da79-8738-4060-8d3d-5484c0e0a462"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:45.479091 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-5726654d-4d24-4610-91e6-55bae9477cec req-1e310edb-8b31-455c-97f7-228eac46c2e0 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:45.479563 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-5726654d-4d24-4610-91e6-55bae9477cec req-1e310edb-8b31-455c-97f7-228eac46c2e0 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:45.483881 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-5726654d-4d24-4610-91e6-55bae9477cec req-1e310edb-8b31-455c-97f7-228eac46c2e0 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:45.493020 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-5726654d-4d24-4610-91e6-55bae9477cec req-1e310edb-8b31-455c-97f7-228eac46c2e0 service nova] Creating event network-changed:6125da79-8738-4060-8d3d-5484c0e0a462 for instance 4c945896-ccdd-42e4-a22c-b21e453512ff on hv-cinder-85144 Aug 26 16:02:45.497890 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-5726654d-4d24-4610-91e6-55bae9477cec req-1e310edb-8b31-455c-97f7-228eac46c2e0 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033393 Aug 26 16:02:45.501271 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 476/930] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:02:46.123239 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-8c6dba60-dccf-4924-bdd5-087ea4018e66 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:46.123913 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-8c6dba60-dccf-4924-bdd5-087ea4018e66 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 842d5015-aa0d-46a5-8162-7201b4277653] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:46.130883 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8c6dba60-dccf-4924-bdd5-087ea4018e66 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:46.131336 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8c6dba60-dccf-4924-bdd5-087ea4018e66 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:46.131778 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8c6dba60-dccf-4924-bdd5-087ea4018e66 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:46.132484 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8c6dba60-dccf-4924-bdd5-087ea4018e66 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:46.132943 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8c6dba60-dccf-4924-bdd5-087ea4018e66 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:46.133380 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8c6dba60-dccf-4924-bdd5-087ea4018e66 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:46.148350 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-8c6dba60-dccf-4924-bdd5-087ea4018e66 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] HTTP exception thrown: Instance 842d5015-aa0d-46a5-8162-7201b4277653 could not be found. Aug 26 16:02:46.150882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-8c6dba60-dccf-4924-bdd5-087ea4018e66 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Request method failure captured: Aug 26 16:02:46.150882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 HTTP/1.1 Aug 26 16:02:46.150882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 16:02:46.150882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 16:02:46.150882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 16:02:46.150882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 0 Aug 26 16:02:46.150882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 16:02:46.150882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 16:02:46.150882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 16:02:46.150882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 16:02:46.150882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO0_sl285hvUjJgmI9tiwf2bPWJ_USKAuZl9qlXiPcbxQIVW1O_h2ghJjLWiyYPk1X7WhbLdFcB00PMIvtPLvDgRyMUSdg3tkWBfuoTGjVfkvNMUX-nJPvr_-GzeeJRuzdQ89_WhGnhJFkicXMewwKHJxRcDkRVBAc7d0S88NP2f2_c Aug 26 16:02:46.150882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 16:02:46.150882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 16:02:46.150882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 16:02:46.150882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 16:02:46.150882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 16:02:46.150882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 16:02:46.150882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: 5f170813ecff47a68d7610de9d769287 Aug 26 16:02:46.150882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1667711701 Aug 26 16:02:46.150882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 16:02:46.150882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 16:02:46.152365 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/5f170813ecff47a68d7610de9d769287"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/5f170813ecff47a68d7610de9d769287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/5f170813ecff47a68d7610de9d769287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_5f170813ecff47a68d7610de9d769287", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:02:46.152365 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1667711701 Aug 26 16:02:46.152365 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: 5f170813ecff47a68d7610de9d769287 Aug 26 16:02:46.152365 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1667711701 Aug 26 16:02:46.152365 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-ServerRescueNegativeTestJSON-1667711701-project Aug 26 16:02:46.152365 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 16:02:46.152365 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 16:02:46.152365 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: 4940f8a9c15a483eab251df392789534 Aug 26 16:02:46.152365 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1667711701-project Aug 26 16:02:46.152365 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: > Aug 26 16:02:46.152365 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Instance 842d5015-aa0d-46a5-8162-7201b4277653 could not be found. Aug 26 16:02:46.152365 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'id': '842d5015-aa0d-46a5-8162-7201b4277653'} Aug 26 16:02:46.153116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:02:46.153116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:02:46.153116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:02:46.153116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:02:46.153116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:02:46.153116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:02:46.153116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:02:46.153116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:02:46.153116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:02:46.153116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:02:46.153116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 842d5015-aa0d-46a5-8162-7201b4277653 could not be found. Aug 26 16:02:46.153116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:02:46.153116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:02:46.153116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:02:46.153116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:02:46.153116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:02:46.153116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:02:46.153116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:02:46.153116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:02:46.153116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:02:46.155242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:02:46.155242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:02:46.155242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:02:46.155242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:02:46.155242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:02:46.155242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:02:46.155242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:02:46.155242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 842d5015-aa0d-46a5-8162-7201b4277653 could not be found. Aug 26 16:02:46.155242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:02:46.155242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:02:46.155242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:02:46.155242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:02:46.155242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:02:46.155242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:02:46.155242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:02:46.155242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:02:46.155242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 842d5015-aa0d-46a5-8162-7201b4277653 could not be found. Aug 26 16:02:46.155242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:02:46.157317 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-8c6dba60-dccf-4924-bdd5-087ea4018e66 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Returning 404 to user: Instance 842d5015-aa0d-46a5-8162-7201b4277653 could not be found. {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:02:46.158167 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-8c6dba60-dccf-4924-bdd5-087ea4018e66 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653" status: 404 len: 111 microversion: 2.1 time: 0.038843 Aug 26 16:02:46.158767 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 455/931] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:46 2022] GET /compute/v2.1/servers/842d5015-aa0d-46a5-8162-7201b4277653 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:02:46.167799 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-c23726b5-fa9e-4895-95fd-0f16b2318085 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '.version_select at 0x7f15d95f6430>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:46.181058 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:46.288695 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-c23726b5-fa9e-4895-95fd-0f16b2318085 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1260259496" status: 202 len: 0 microversion: 2.1 time: 0.125246 Aug 26 16:02:46.289407 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 477/932] 10.222.0.94 () {58 vars in 1221 bytes} [Fri Aug 26 16:02:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1260259496 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 16:02:49.639440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ba9547db-e094-45a2-a1af-5b1bee16ad85 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:49.639927 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ba9547db-e094-45a2-a1af-5b1bee16ad85 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:49.647431 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba9547db-e094-45a2-a1af-5b1bee16ad85 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:49.647921 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba9547db-e094-45a2-a1af-5b1bee16ad85 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:49.648362 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba9547db-e094-45a2-a1af-5b1bee16ad85 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:49.649055 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba9547db-e094-45a2-a1af-5b1bee16ad85 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:49.649514 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba9547db-e094-45a2-a1af-5b1bee16ad85 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:49.649967 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba9547db-e094-45a2-a1af-5b1bee16ad85 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:49.676945 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ba9547db-e094-45a2-a1af-5b1bee16ad85 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Going to try to terminate instance {{(pid=128304) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 16:02:49.949061 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ba9547db-e094-45a2-a1af-5b1bee16ad85 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "DELETE /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 204 len: 0 microversion: 2.1 time: 0.313115 Aug 26 16:02:49.949594 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 456/933] 10.222.0.94 () {58 vars in 1239 bytes} [Fri Aug 26 16:02:49 2022] DELETE /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 16:02:49.958688 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-3da1ec86-9e64-4141-8dd6-d6cec5ab92bb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:49.959562 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-3da1ec86-9e64-4141-8dd6-d6cec5ab92bb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:49.966432 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3da1ec86-9e64-4141-8dd6-d6cec5ab92bb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:49.966940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3da1ec86-9e64-4141-8dd6-d6cec5ab92bb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:49.967389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3da1ec86-9e64-4141-8dd6-d6cec5ab92bb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:49.968076 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3da1ec86-9e64-4141-8dd6-d6cec5ab92bb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:49.968520 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3da1ec86-9e64-4141-8dd6-d6cec5ab92bb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:49.968937 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3da1ec86-9e64-4141-8dd6-d6cec5ab92bb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:50.098823 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-3da1ec86-9e64-4141-8dd6-d6cec5ab92bb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:50.106581 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-3da1ec86-9e64-4141-8dd6-d6cec5ab92bb tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1509 microversion: 2.1 time: 0.152679 Aug 26 16:02:50.107181 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 478/934] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:49 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:51.129196 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-51b639ce-c718-4233-b15a-a72909015fc5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:51.129881 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-51b639ce-c718-4233-b15a-a72909015fc5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:51.136307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-51b639ce-c718-4233-b15a-a72909015fc5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:51.136784 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-51b639ce-c718-4233-b15a-a72909015fc5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:51.137215 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-51b639ce-c718-4233-b15a-a72909015fc5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:51.137898 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-51b639ce-c718-4233-b15a-a72909015fc5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:51.138346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-51b639ce-c718-4233-b15a-a72909015fc5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:51.138768 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-51b639ce-c718-4233-b15a-a72909015fc5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:51.268921 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-51b639ce-c718-4233-b15a-a72909015fc5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:51.276670 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-51b639ce-c718-4233-b15a-a72909015fc5 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1509 microversion: 2.1 time: 0.152406 Aug 26 16:02:51.277232 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 457/935] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:51 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:52.297345 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-c2e6c3bc-31ba-45d2-b4ff-cf4ebd66acfc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:52.298365 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-c2e6c3bc-31ba-45d2-b4ff-cf4ebd66acfc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:52.304817 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c2e6c3bc-31ba-45d2-b4ff-cf4ebd66acfc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:52.305299 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c2e6c3bc-31ba-45d2-b4ff-cf4ebd66acfc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:52.305736 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c2e6c3bc-31ba-45d2-b4ff-cf4ebd66acfc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:52.306441 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c2e6c3bc-31ba-45d2-b4ff-cf4ebd66acfc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:52.306894 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c2e6c3bc-31ba-45d2-b4ff-cf4ebd66acfc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:52.307355 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c2e6c3bc-31ba-45d2-b4ff-cf4ebd66acfc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:52.520543 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-c2e6c3bc-31ba-45d2-b4ff-cf4ebd66acfc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:52.528942 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-c2e6c3bc-31ba-45d2-b4ff-cf4ebd66acfc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1509 microversion: 2.1 time: 0.235395 Aug 26 16:02:52.529557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 479/936] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:52 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1509 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:52.850071 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-7caa6709-6dc7-4074-bd63-196511f12121 req-53564e90-55b8-483f-8e0a-21579c5b131a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c04e0499-9326-4fe8-8e28-80be6b0d7a14", "name": "network-vif-deleted", "tag": "add18eae-55b9-4447-82eb-6d50b51bc859"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:52.860204 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-7caa6709-6dc7-4074-bd63-196511f12121 req-53564e90-55b8-483f-8e0a-21579c5b131a service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:52.860667 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-7caa6709-6dc7-4074-bd63-196511f12121 req-53564e90-55b8-483f-8e0a-21579c5b131a service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:52.861087 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-7caa6709-6dc7-4074-bd63-196511f12121 req-53564e90-55b8-483f-8e0a-21579c5b131a service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:52.872849 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-7caa6709-6dc7-4074-bd63-196511f12121 req-53564e90-55b8-483f-8e0a-21579c5b131a service nova] Creating event network-vif-deleted:add18eae-55b9-4447-82eb-6d50b51bc859 for instance c04e0499-9326-4fe8-8e28-80be6b0d7a14 on hv-cinder-85144 Aug 26 16:02:52.878143 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-7caa6709-6dc7-4074-bd63-196511f12121 req-53564e90-55b8-483f-8e0a-21579c5b131a service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031649 Aug 26 16:02:52.878764 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 458/937] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:02:53.550527 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-82c42114-f055-42bd-9b32-8940344fc857 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:53.551556 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-82c42114-f055-42bd-9b32-8940344fc857 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:53.558140 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-82c42114-f055-42bd-9b32-8940344fc857 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:53.558506 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-82c42114-f055-42bd-9b32-8940344fc857 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:53.558958 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-82c42114-f055-42bd-9b32-8940344fc857 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:53.559700 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-82c42114-f055-42bd-9b32-8940344fc857 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:53.560156 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-82c42114-f055-42bd-9b32-8940344fc857 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:53.560603 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-82c42114-f055-42bd-9b32-8940344fc857 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:53.565958 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=100 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:53.593853 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-82c42114-f055-42bd-9b32-8940344fc857 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:53.594344 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-82c42114-f055-42bd-9b32-8940344fc857 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:53.594979 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-82c42114-f055-42bd-9b32-8940344fc857 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:53.595487 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-82c42114-f055-42bd-9b32-8940344fc857 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lazy-loading 'fault' on Instance uuid c04e0499-9326-4fe8-8e28-80be6b0d7a14 {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:02:53.636908 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-82c42114-f055-42bd-9b32-8940344fc857 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:53.644606 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-82c42114-f055-42bd-9b32-8940344fc857 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 200 len: 1312 microversion: 2.1 time: 0.098903 Aug 26 16:02:53.645169 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 480/938] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:53 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:54.666255 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-6087d3b6-c157-4c2a-9d56-5df1c07cde57 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:54.666972 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-6087d3b6-c157-4c2a-9d56-5df1c07cde57 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: c04e0499-9326-4fe8-8e28-80be6b0d7a14] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:54.673923 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6087d3b6-c157-4c2a-9d56-5df1c07cde57 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:54.674404 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6087d3b6-c157-4c2a-9d56-5df1c07cde57 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:54.674844 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6087d3b6-c157-4c2a-9d56-5df1c07cde57 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:54.675564 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6087d3b6-c157-4c2a-9d56-5df1c07cde57 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:54.676021 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6087d3b6-c157-4c2a-9d56-5df1c07cde57 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:54.676457 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6087d3b6-c157-4c2a-9d56-5df1c07cde57 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:54.679110 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:02:54.690508 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-6087d3b6-c157-4c2a-9d56-5df1c07cde57 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] HTTP exception thrown: Instance c04e0499-9326-4fe8-8e28-80be6b0d7a14 could not be found. Aug 26 16:02:54.693823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-6087d3b6-c157-4c2a-9d56-5df1c07cde57 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Request method failure captured: Aug 26 16:02:54.693823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 HTTP/1.1 Aug 26 16:02:54.693823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 16:02:54.693823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 16:02:54.693823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 16:02:54.693823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 0 Aug 26 16:02:54.693823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 16:02:54.693823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 16:02:54.693823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 16:02:54.693823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 16:02:54.693823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO0_sl285hvUjJgmI9tiwf2bPWJ_USKAuZl9qlXiPcbxQIVW1O_h2ghJjLWiyYPk1X7WhbLdFcB00PMIvtPLvDgRyMUSdg3tkWBfuoTGjVfkvNMUX-nJPvr_-GzeeJRuzdQ89_WhGnhJFkicXMewwKHJxRcDkRVBAc7d0S88NP2f2_c Aug 26 16:02:54.693823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 16:02:54.693823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 16:02:54.693823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 16:02:54.693823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 16:02:54.693823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 16:02:54.693823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 16:02:54.693823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: 5f170813ecff47a68d7610de9d769287 Aug 26 16:02:54.693823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1667711701 Aug 26 16:02:54.693823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 16:02:54.693823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 16:02:54.695741 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/5f170813ecff47a68d7610de9d769287"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/5f170813ecff47a68d7610de9d769287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/5f170813ecff47a68d7610de9d769287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_5f170813ecff47a68d7610de9d769287", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:02:54.695741 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1667711701 Aug 26 16:02:54.695741 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: 5f170813ecff47a68d7610de9d769287 Aug 26 16:02:54.695741 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1667711701 Aug 26 16:02:54.695741 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-ServerRescueNegativeTestJSON-1667711701-project Aug 26 16:02:54.695741 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 16:02:54.695741 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 16:02:54.695741 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: 4940f8a9c15a483eab251df392789534 Aug 26 16:02:54.695741 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1667711701-project Aug 26 16:02:54.695741 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: > Aug 26 16:02:54.695741 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Instance c04e0499-9326-4fe8-8e28-80be6b0d7a14 could not be found. Aug 26 16:02:54.695741 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'id': 'c04e0499-9326-4fe8-8e28-80be6b0d7a14'} Aug 26 16:02:54.696642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:02:54.696642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:02:54.696642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:02:54.696642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:02:54.696642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:02:54.696642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:02:54.696642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:02:54.696642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:02:54.696642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:02:54.696642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:02:54.696642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c04e0499-9326-4fe8-8e28-80be6b0d7a14 could not be found. Aug 26 16:02:54.696642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:02:54.696642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:02:54.696642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:02:54.696642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:02:54.696642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:02:54.696642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:02:54.696642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:02:54.696642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:02:54.696642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:02:54.698117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:02:54.698117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:02:54.698117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:02:54.698117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:02:54.698117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:02:54.698117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:02:54.698117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:02:54.698117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c04e0499-9326-4fe8-8e28-80be6b0d7a14 could not be found. Aug 26 16:02:54.698117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:02:54.698117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:02:54.698117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:02:54.698117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:02:54.698117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:02:54.698117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:02:54.698117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:02:54.698117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:02:54.698117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c04e0499-9326-4fe8-8e28-80be6b0d7a14 could not be found. Aug 26 16:02:54.698117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:02:54.699489 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-6087d3b6-c157-4c2a-9d56-5df1c07cde57 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Returning 404 to user: Instance c04e0499-9326-4fe8-8e28-80be6b0d7a14 could not be found. {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:02:54.699489 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-6087d3b6-c157-4c2a-9d56-5df1c07cde57 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14" status: 404 len: 111 microversion: 2.1 time: 0.031976 Aug 26 16:02:54.699489 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 459/939] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:54 2022] GET /compute/v2.1/servers/c04e0499-9326-4fe8-8e28-80be6b0d7a14 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:02:54.702447 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-f0624f9f-660a-4d7d-b310-63412f3937bc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:54.703009 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-f0624f9f-660a-4d7d-b310-63412f3937bc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:54.709775 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f0624f9f-660a-4d7d-b310-63412f3937bc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:54.710261 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f0624f9f-660a-4d7d-b310-63412f3937bc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:54.710697 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f0624f9f-660a-4d7d-b310-63412f3937bc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:54.711522 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f0624f9f-660a-4d7d-b310-63412f3937bc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:54.711980 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f0624f9f-660a-4d7d-b310-63412f3937bc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:54.712479 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f0624f9f-660a-4d7d-b310-63412f3937bc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:54.740260 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-f0624f9f-660a-4d7d-b310-63412f3937bc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Going to try to terminate instance {{(pid=128305) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 16:02:55.046345 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-f0624f9f-660a-4d7d-b310-63412f3937bc tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "DELETE /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 204 len: 0 microversion: 2.1 time: 0.347534 Aug 26 16:02:55.047162 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 481/940] 10.222.0.94 () {58 vars in 1239 bytes} [Fri Aug 26 16:02:54 2022] DELETE /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 16:02:55.061908 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-451a26c9-c773-40d1-a775-e7d2c831bd79 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:55.062604 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-451a26c9-c773-40d1-a775-e7d2c831bd79 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:55.069572 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-451a26c9-c773-40d1-a775-e7d2c831bd79 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:55.070062 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-451a26c9-c773-40d1-a775-e7d2c831bd79 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:55.070503 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-451a26c9-c773-40d1-a775-e7d2c831bd79 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:55.071232 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-451a26c9-c773-40d1-a775-e7d2c831bd79 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:55.071722 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-451a26c9-c773-40d1-a775-e7d2c831bd79 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:55.072201 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-451a26c9-c773-40d1-a775-e7d2c831bd79 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:55.206161 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-451a26c9-c773-40d1-a775-e7d2c831bd79 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:55.214149 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-451a26c9-c773-40d1-a775-e7d2c831bd79 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.156572 Aug 26 16:02:55.214852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 460/941] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:55 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:56.236869 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-73ca06d4-13af-4d49-ab83-add2e474d4a4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:56.237582 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-73ca06d4-13af-4d49-ab83-add2e474d4a4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:56.244129 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-73ca06d4-13af-4d49-ab83-add2e474d4a4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:56.244607 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-73ca06d4-13af-4d49-ab83-add2e474d4a4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:56.245047 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-73ca06d4-13af-4d49-ab83-add2e474d4a4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:56.245734 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-73ca06d4-13af-4d49-ab83-add2e474d4a4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:56.246188 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-73ca06d4-13af-4d49-ab83-add2e474d4a4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:56.246609 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-73ca06d4-13af-4d49-ab83-add2e474d4a4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:56.378409 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-73ca06d4-13af-4d49-ab83-add2e474d4a4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:56.386252 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-73ca06d4-13af-4d49-ab83-add2e474d4a4 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.154242 Aug 26 16:02:56.386810 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 482/942] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:56 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:57.407085 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-fb471f45-4023-4fa7-87f7-43225c236116 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:57.407850 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-fb471f45-4023-4fa7-87f7-43225c236116 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:57.414278 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fb471f45-4023-4fa7-87f7-43225c236116 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:57.414765 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fb471f45-4023-4fa7-87f7-43225c236116 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:57.415238 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fb471f45-4023-4fa7-87f7-43225c236116 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:57.419794 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fb471f45-4023-4fa7-87f7-43225c236116 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:57.419794 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fb471f45-4023-4fa7-87f7-43225c236116 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:57.419794 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fb471f45-4023-4fa7-87f7-43225c236116 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:57.548230 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-fb471f45-4023-4fa7-87f7-43225c236116 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:57.555750 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-fb471f45-4023-4fa7-87f7-43225c236116 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.152747 Aug 26 16:02:57.556311 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 461/943] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:57 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:58.426956 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-5362dd3a-5eef-45b6-8131-2b4cc3df84a1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:58.427508 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-5362dd3a-5eef-45b6-8131-2b4cc3df84a1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:58.433887 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5362dd3a-5eef-45b6-8131-2b4cc3df84a1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:58.434361 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5362dd3a-5eef-45b6-8131-2b4cc3df84a1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:58.434794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5362dd3a-5eef-45b6-8131-2b4cc3df84a1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:58.435498 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5362dd3a-5eef-45b6-8131-2b4cc3df84a1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:58.435944 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5362dd3a-5eef-45b6-8131-2b4cc3df84a1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:58.436364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5362dd3a-5eef-45b6-8131-2b4cc3df84a1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:58.461052 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-5362dd3a-5eef-45b6-8131-2b4cc3df84a1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3/ips" status: 200 len: 149 microversion: 2.1 time: 0.038112 Aug 26 16:02:58.461633 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 483/944] 10.222.0.94 () {58 vars in 1248 bytes} [Fri Aug 26 16:02:58 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:02:58.577713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-295e6e9c-0c99-45b6-a20e-60c79f3c7b6a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:02:58.578359 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-295e6e9c-0c99-45b6-a20e-60c79f3c7b6a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:02:58.585516 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-295e6e9c-0c99-45b6-a20e-60c79f3c7b6a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:58.586004 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-295e6e9c-0c99-45b6-a20e-60c79f3c7b6a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:58.586441 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-295e6e9c-0c99-45b6-a20e-60c79f3c7b6a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:58.587182 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-295e6e9c-0c99-45b6-a20e-60c79f3c7b6a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:58.587642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-295e6e9c-0c99-45b6-a20e-60c79f3c7b6a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:58.588076 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-295e6e9c-0c99-45b6-a20e-60c79f3c7b6a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:59.074448 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-295e6e9c-0c99-45b6-a20e-60c79f3c7b6a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:02:59.082871 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-295e6e9c-0c99-45b6-a20e-60c79f3c7b6a tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1522 microversion: 2.1 time: 0.509060 Aug 26 16:02:59.083528 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 462/945] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:02:58 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1522 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:02:59.399946 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-c59913d2-f95d-47a1-96f5-c22887d6aa64 req-6408d27a-dca8-4ec1-b46d-7111306efd3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a7ee09-cb33-4638-a620-e36bc333cec6", "name": "network-vif-deleted", "tag": "56c21eb3-a5af-49a5-afc3-c79bf7878007"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:02:59.410193 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-c59913d2-f95d-47a1-96f5-c22887d6aa64 req-6408d27a-dca8-4ec1-b46d-7111306efd3c service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:02:59.410676 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-c59913d2-f95d-47a1-96f5-c22887d6aa64 req-6408d27a-dca8-4ec1-b46d-7111306efd3c service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:02:59.411149 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-c59913d2-f95d-47a1-96f5-c22887d6aa64 req-6408d27a-dca8-4ec1-b46d-7111306efd3c service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:02:59.422058 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-c59913d2-f95d-47a1-96f5-c22887d6aa64 req-6408d27a-dca8-4ec1-b46d-7111306efd3c service nova] Creating event network-vif-deleted:56c21eb3-a5af-49a5-afc3-c79bf7878007 for instance 18a7ee09-cb33-4638-a620-e36bc333cec6 on hv-cinder-85144 Aug 26 16:02:59.427871 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-c59913d2-f95d-47a1-96f5-c22887d6aa64 req-6408d27a-dca8-4ec1-b46d-7111306efd3c service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031638 Aug 26 16:02:59.431307 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 484/946] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:03:00.104967 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-e236c3d4-dd59-4efe-97a0-f21a5a9cc4e9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:00.105584 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-e236c3d4-dd59-4efe-97a0-f21a5a9cc4e9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:00.113499 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e236c3d4-dd59-4efe-97a0-f21a5a9cc4e9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:00.113996 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e236c3d4-dd59-4efe-97a0-f21a5a9cc4e9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:00.114436 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e236c3d4-dd59-4efe-97a0-f21a5a9cc4e9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:00.115161 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e236c3d4-dd59-4efe-97a0-f21a5a9cc4e9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:00.115648 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e236c3d4-dd59-4efe-97a0-f21a5a9cc4e9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:00.116071 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e236c3d4-dd59-4efe-97a0-f21a5a9cc4e9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:00.156461 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e236c3d4-dd59-4efe-97a0-f21a5a9cc4e9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:00.156946 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e236c3d4-dd59-4efe-97a0-f21a5a9cc4e9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:00.157396 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e236c3d4-dd59-4efe-97a0-f21a5a9cc4e9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:00.157857 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.objects.instance [None req-e236c3d4-dd59-4efe-97a0-f21a5a9cc4e9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lazy-loading 'fault' on Instance uuid 18a7ee09-cb33-4638-a620-e36bc333cec6 {{(pid=128304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:03:00.199303 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e236c3d4-dd59-4efe-97a0-f21a5a9cc4e9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4940f8a9c15a483eab251df392789534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f170813ecff47a68d7610de9d769287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:00.207551 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-e236c3d4-dd59-4efe-97a0-f21a5a9cc4e9 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 200 len: 1311 microversion: 2.1 time: 0.106524 Aug 26 16:03:00.208119 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 463/947] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:00 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 1311 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:03:00.290099 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-3b519f99-e1da-4e72-8a0c-29198dc3c8fb tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2527aeee-ed3c-48b4-aab7-f505292c0a30"}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:03:00.292563 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-3b519f99-e1da-4e72-8a0c-29198dc3c8fb tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:00.298641 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3b519f99-e1da-4e72-8a0c-29198dc3c8fb tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:00.299740 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3b519f99-e1da-4e72-8a0c-29198dc3c8fb tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:00.300225 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3b519f99-e1da-4e72-8a0c-29198dc3c8fb tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:00.300953 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3b519f99-e1da-4e72-8a0c-29198dc3c8fb tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:00.301403 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3b519f99-e1da-4e72-8a0c-29198dc3c8fb tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:00.301826 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3b519f99-e1da-4e72-8a0c-29198dc3c8fb tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:01.228423 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f56b1682-7ddf-4fb2-b7a4-61455e181a56 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:01.229030 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-f56b1682-7ddf-4fb2-b7a4-61455e181a56 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] [instance: 18a7ee09-cb33-4638-a620-e36bc333cec6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:01.235332 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f56b1682-7ddf-4fb2-b7a4-61455e181a56 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:01.235811 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f56b1682-7ddf-4fb2-b7a4-61455e181a56 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:01.236246 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f56b1682-7ddf-4fb2-b7a4-61455e181a56 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:01.237276 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f56b1682-7ddf-4fb2-b7a4-61455e181a56 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:01.238098 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f56b1682-7ddf-4fb2-b7a4-61455e181a56 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:01.238889 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f56b1682-7ddf-4fb2-b7a4-61455e181a56 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:01.252237 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-f56b1682-7ddf-4fb2-b7a4-61455e181a56 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] HTTP exception thrown: Instance 18a7ee09-cb33-4638-a620-e36bc333cec6 could not be found. Aug 26 16:03:01.253919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f56b1682-7ddf-4fb2-b7a4-61455e181a56 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Request method failure captured: Aug 26 16:03:01.253919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 HTTP/1.1 Aug 26 16:03:01.253919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 16:03:01.253919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 16:03:01.253919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 16:03:01.253919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 0 Aug 26 16:03:01.253919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 16:03:01.253919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 16:03:01.253919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 16:03:01.253919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 16:03:01.253919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO0_sl285hvUjJgmI9tiwf2bPWJ_USKAuZl9qlXiPcbxQIVW1O_h2ghJjLWiyYPk1X7WhbLdFcB00PMIvtPLvDgRyMUSdg3tkWBfuoTGjVfkvNMUX-nJPvr_-GzeeJRuzdQ89_WhGnhJFkicXMewwKHJxRcDkRVBAc7d0S88NP2f2_c Aug 26 16:03:01.253919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 16:03:01.253919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 16:03:01.253919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 16:03:01.253919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 16:03:01.253919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 16:03:01.253919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 16:03:01.253919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: 5f170813ecff47a68d7610de9d769287 Aug 26 16:03:01.253919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1667711701 Aug 26 16:03:01.253919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 16:03:01.253919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 16:03:01.258415 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/5f170813ecff47a68d7610de9d769287"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/5f170813ecff47a68d7610de9d769287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/5f170813ecff47a68d7610de9d769287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_5f170813ecff47a68d7610de9d769287", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:03:01.258415 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1667711701 Aug 26 16:03:01.258415 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: 5f170813ecff47a68d7610de9d769287 Aug 26 16:03:01.258415 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1667711701 Aug 26 16:03:01.258415 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-ServerRescueNegativeTestJSON-1667711701-project Aug 26 16:03:01.258415 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 16:03:01.258415 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 16:03:01.258415 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: 4940f8a9c15a483eab251df392789534 Aug 26 16:03:01.258415 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1667711701-project Aug 26 16:03:01.258415 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: > Aug 26 16:03:01.258415 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Instance 18a7ee09-cb33-4638-a620-e36bc333cec6 could not be found. Aug 26 16:03:01.258415 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'id': '18a7ee09-cb33-4638-a620-e36bc333cec6'} Aug 26 16:03:01.259449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:03:01.259449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:03:01.259449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:03:01.259449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:03:01.259449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:03:01.259449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:03:01.259449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:03:01.259449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:03:01.259449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:03:01.259449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:03:01.259449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18a7ee09-cb33-4638-a620-e36bc333cec6 could not be found. Aug 26 16:03:01.259449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:03:01.259449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:03:01.259449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:03:01.259449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:03:01.259449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:03:01.259449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:03:01.259449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:03:01.259449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:03:01.259449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:03:01.260878 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:03:01.260878 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:03:01.260878 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:03:01.260878 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:03:01.260878 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:03:01.260878 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:03:01.260878 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:03:01.260878 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18a7ee09-cb33-4638-a620-e36bc333cec6 could not be found. Aug 26 16:03:01.260878 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:03:01.260878 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:03:01.260878 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:03:01.260878 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:03:01.260878 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:03:01.260878 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:03:01.260878 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:03:01.260878 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:03:01.260878 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18a7ee09-cb33-4638-a620-e36bc333cec6 could not be found. Aug 26 16:03:01.260878 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:03:01.262725 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f56b1682-7ddf-4fb2-b7a4-61455e181a56 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] Returning 404 to user: Instance 18a7ee09-cb33-4638-a620-e36bc333cec6 could not be found. {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:03:01.262725 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-f56b1682-7ddf-4fb2-b7a4-61455e181a56 tempest-ServerRescueNegativeTestJSON-1667711701 tempest-ServerRescueNegativeTestJSON-1667711701-project] 10.222.0.94 "GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6" status: 404 len: 111 microversion: 2.1 time: 0.030706 Aug 26 16:03:01.262725 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 464/948] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:01 2022] GET /compute/v2.1/servers/18a7ee09-cb33-4638-a620-e36bc333cec6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 16:03:01.421679 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-3b519f99-e1da-4e72-8a0c-29198dc3c8fb tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "POST /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.136364 Aug 26 16:03:01.423713 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 485/949] 10.222.0.94 () {60 vars in 1323 bytes} [Fri Aug 26 16:03:00 2022] POST /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3/os-volume_attachments => generated 194 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:03:06.929560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-075c153d-a7d5-4564-af3a-50ab1281f19b tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] Action: 'create', calling method: .version_select at 0x7f15d94baa60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-745441005"}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:03:07.658605 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-075c153d-a7d5-4564-af3a-50ab1281f19b tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] 10.222.0.94 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.843387 Aug 26 16:03:07.659288 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 465/950] 10.222.0.94 () {60 vars in 1155 bytes} [Fri Aug 26 16:03:06 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 845 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 26 16:03:07.672587 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-6c9db3d7-cb8a-4511-812a-1f82f5abda83 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] Calling method '.version_select at 0x7f15d9621040>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:07.725688 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-6c9db3d7-cb8a-4511-812a-1f82f5abda83 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/20e2df9d-d5c6-41e4-b1d0-147f898f9db2" status: 200 len: 344 microversion: 2.1 time: 0.057349 Aug 26 16:03:07.728340 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 486/951] 10.222.0.94 () {58 vars in 1245 bytes} [Fri Aug 26 16:03:07 2022] GET /compute/v2.1/os-volumes/20e2df9d-d5c6-41e4-b1d0-147f898f9db2 => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:03:08.740841 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-724eac92-4a1a-4b91-8b87-d555b857fb1b tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] Calling method '.version_select at 0x7f15d96e11f0>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:08.789506 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-724eac92-4a1a-4b91-8b87-d555b857fb1b tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/20e2df9d-d5c6-41e4-b1d0-147f898f9db2" status: 200 len: 345 microversion: 2.1 time: 0.053750 Aug 26 16:03:08.790067 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 466/952] 10.222.0.94 () {58 vars in 1245 bytes} [Fri Aug 26 16:03:08 2022] GET /compute/v2.1/os-volumes/20e2df9d-d5c6-41e4-b1d0-147f898f9db2 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:03:08.803647 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-7b5b7302-c205-44af-84d0-ff2d34d47708 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] Action: 'create', calling method: .version_select at 0x7f15d99da310>, body: {"snapshot": {"volume_id": "20e2df9d-d5c6-41e4-b1d0-147f898f9db2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-486375152"}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:03:09.361816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-7b5b7302-c205-44af-84d0-ff2d34d47708 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] 10.222.0.94 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.563163 Aug 26 16:03:09.362510 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 487/953] 10.222.0.94 () {60 vars in 1162 bytes} [Fri Aug 26 16:03:08 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:03:09.373477 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-06ee705e-7e12-45b9-95e9-33d64dffcf8d tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] Calling method '.version_select at 0x7f15d9537ca0>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:09.403028 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-06ee705e-7e12-45b9-95e9-33d64dffcf8d tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/d54c84a0-fa93-4ccf-89bf-417c7049c522" status: 200 len: 286 microversion: 2.1 time: 0.033141 Aug 26 16:03:09.403603 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 467/954] 10.222.0.94 () {58 vars in 1251 bytes} [Fri Aug 26 16:03:09 2022] GET /compute/v2.1/os-snapshots/d54c84a0-fa93-4ccf-89bf-417c7049c522 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:03:09.415553 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-48147b79-d737-4b42-b7fe-ff45d4032e83 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] Calling method '.version_select at 0x7f15d9694310>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:09.446663 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-48147b79-d737-4b42-b7fe-ff45d4032e83 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.035674 Aug 26 16:03:09.447260 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 488/955] 10.222.0.94 () {58 vars in 1140 bytes} [Fri Aug 26 16:03:09 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:03:09.458242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-0fbbc5ac-372a-4701-bbd6-9c69e30a3310 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] Calling method '.version_select at 0x7f15d94ba280>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:09.490179 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-0fbbc5ac-372a-4701-bbd6-9c69e30a3310 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/d54c84a0-fa93-4ccf-89bf-417c7049c522" status: 200 len: 286 microversion: 2.1 time: 0.035436 Aug 26 16:03:09.490980 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 468/956] 10.222.0.94 () {58 vars in 1251 bytes} [Fri Aug 26 16:03:09 2022] GET /compute/v2.1/os-snapshots/d54c84a0-fa93-4ccf-89bf-417c7049c522 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:03:10.025808 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-18a1702e-3e97-4a9c-a410-977a07cf2c26 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2527aeee-ed3c-48b4-aab7-f505292c0a30"}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:03:10.028263 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-18a1702e-3e97-4a9c-a410-977a07cf2c26 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:10.034908 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-18a1702e-3e97-4a9c-a410-977a07cf2c26 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:10.035413 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-18a1702e-3e97-4a9c-a410-977a07cf2c26 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:10.035854 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-18a1702e-3e97-4a9c-a410-977a07cf2c26 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:10.036541 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-18a1702e-3e97-4a9c-a410-977a07cf2c26 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:10.037026 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-18a1702e-3e97-4a9c-a410-977a07cf2c26 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:10.037521 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-18a1702e-3e97-4a9c-a410-977a07cf2c26 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:10.117733 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.wsgi [None req-18a1702e-3e97-4a9c-a410-977a07cf2c26 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] HTTP exception thrown: Invalid volume: volume 2527aeee-ed3c-48b4-aab7-f505292c0a30 is already attached to instances: f241a343-9b6e-471f-9a18-964d506fe4f3 Aug 26 16:03:10.119625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-18a1702e-3e97-4a9c-a410-977a07cf2c26 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Request method failure captured: Aug 26 16:03:10.119625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: request: POST /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3/os-volume_attachments HTTP/1.1 Aug 26 16:03:10.119625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept: application/json Aug 26 16:03:10.119625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept-Encoding: identity Aug 26 16:03:10.119625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Connection: close Aug 26 16:03:10.119625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Length: 74 Aug 26 16:03:10.119625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Type: application/json Aug 26 16:03:10.119625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Host: 10.222.0.94 Aug 26 16:03:10.119625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Openstack-System-Scope: None Aug 26 16:03:10.119625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: User-Agent: python-urllib3/1.26.11 Aug 26 16:03:10.119625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Auth-Token: gAAAAABjCO074Vk8Knkkyah_6hQlXk9FvzAhBqPeYMng3gGU-fQ_qYYEN-UvSDuAz2OG4j3gRVAyM63Qk6cGXT3e_LJrqtVIQ2Wh_rCIb7SpxdZF5G6vc_eR0N-2MIzlwTSdPywpn1m7Hkaqaj-3SiKQy1JcwWLQlfAR9RAjH6drO8qCv3BIADQ Aug 26 16:03:10.119625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Id: None Aug 26 16:03:10.119625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Name: None Aug 26 16:03:10.119625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Identity-Status: Confirmed Aug 26 16:03:10.119625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Is-Admin-Project: True Aug 26 16:03:10.119625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Id: default Aug 26 16:03:10.119625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Name: Default Aug 26 16:03:10.119625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Id: d95f731096d74a089f4161f5db69280c Aug 26 16:03:10.119625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Name: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:03:10.119625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Role: member,reader Aug 26 16:03:10.119625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Roles: member,reader Aug 26 16:03:10.121060 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/d95f731096d74a089f4161f5db69280c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/d95f731096d74a089f4161f5db69280c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/d95f731096d74a089f4161f5db69280c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_d95f731096d74a089f4161f5db69280c", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:03:10.121060 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:03:10.121060 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Id: d95f731096d74a089f4161f5db69280c Aug 26 16:03:10.121060 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:03:10.121060 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User: tempest-AttachVolumeNegativeTest-243089979-project Aug 26 16:03:10.121060 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Id: default Aug 26 16:03:10.121060 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Name: Default Aug 26 16:03:10.121060 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Id: b50041d36b0b430badd6442a2f09f063 Aug 26 16:03:10.121060 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Name: tempest-AttachVolumeNegativeTest-243089979-project Aug 26 16:03:10.121060 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Aug 26 16:03:10.121060 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {"volumeAttachment": {"volumeId": "2527aeee-ed3c-48b4-aab7-f505292c0a30"}} Aug 26 16:03:10.121060 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: method: > Aug 26 16:03:10.121902 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: exception: Invalid volume: volume 2527aeee-ed3c-48b4-aab7-f505292c0a30 is already attached to instances: f241a343-9b6e-471f-9a18-964d506fe4f3 Aug 26 16:03:10.121902 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: action_args: {'server_id': 'f241a343-9b6e-471f-9a18-964d506fe4f3', 'body': {'volumeAttachment': {'volumeId': '2527aeee-ed3c-48b4-aab7-f505292c0a30'}}} Aug 26 16:03:10.121902 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:03:10.121902 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:03:10.121902 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 26 16:03:10.121902 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 26 16:03:10.121902 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 16:03:10.121902 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 16:03:10.121902 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 26 16:03:10.121902 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 26 16:03:10.121902 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 26 16:03:10.121902 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 26 16:03:10.121902 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 26 16:03:10.121902 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 26 16:03:10.121902 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2527aeee-ed3c-48b4-aab7-f505292c0a30 is already attached to instances: f241a343-9b6e-471f-9a18-964d506fe4f3 Aug 26 16:03:10.121902 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:03:10.121902 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:03:10.121902 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:03:10.121902 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:03:10.123157 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:03:10.123157 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:03:10.123157 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:03:10.123157 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:03:10.123157 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:03:10.123157 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:03:10.123157 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 16:03:10.123157 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 16:03:10.123157 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 16:03:10.123157 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 16:03:10.123157 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 16:03:10.123157 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 16:03:10.123157 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 26 16:03:10.123157 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 26 16:03:10.123157 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2527aeee-ed3c-48b4-aab7-f505292c0a30 is already attached to instances: f241a343-9b6e-471f-9a18-964d506fe4f3 Aug 26 16:03:10.123157 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:03:10.123157 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:03:10.123157 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:03:10.123157 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:03:10.123157 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:03:10.124445 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:03:10.124445 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:03:10.124445 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:03:10.124445 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2527aeee-ed3c-48b4-aab7-f505292c0a30 is already attached to instances: f241a343-9b6e-471f-9a18-964d506fe4f3 Aug 26 16:03:10.124445 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:03:10.124445 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-18a1702e-3e97-4a9c-a410-977a07cf2c26 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Returning 400 to user: Invalid volume: volume 2527aeee-ed3c-48b4-aab7-f505292c0a30 is already attached to instances: f241a343-9b6e-471f-9a18-964d506fe4f3 {{(pid=128305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:03:10.124445 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-18a1702e-3e97-4a9c-a410-977a07cf2c26 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "POST /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100191 Aug 26 16:03:10.124445 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 489/957] 10.222.0.94 () {60 vars in 1323 bytes} [Fri Aug 26 16:03:10 2022] POST /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 16:03:10.188375 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-a2640dd1-e4a7-4b58-9d29-1ea921e482c2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:10.188888 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-a2640dd1-e4a7-4b58-9d29-1ea921e482c2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:10.195913 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a2640dd1-e4a7-4b58-9d29-1ea921e482c2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:10.196428 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a2640dd1-e4a7-4b58-9d29-1ea921e482c2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:10.196869 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a2640dd1-e4a7-4b58-9d29-1ea921e482c2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:10.197634 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a2640dd1-e4a7-4b58-9d29-1ea921e482c2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:10.198158 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a2640dd1-e4a7-4b58-9d29-1ea921e482c2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:10.198588 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a2640dd1-e4a7-4b58-9d29-1ea921e482c2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:10.280684 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.objects.instance [None req-a2640dd1-e4a7-4b58-9d29-1ea921e482c2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lazy-loading 'services' on Instance uuid f241a343-9b6e-471f-9a18-964d506fe4f3 {{(pid=128304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:03:10.502599 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-6167b389-b955-48d6-820b-f0c5390b872d tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] Calling method '.version_select at 0x7f15dce7f160>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:10.514671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-a2640dd1-e4a7-4b58-9d29-1ea921e482c2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "DELETE /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3/os-volume_attachments/2527aeee-ed3c-48b4-aab7-f505292c0a30" status: 202 len: 0 microversion: 2.1 time: 0.330664 Aug 26 16:03:10.518808 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 469/958] 10.222.0.94 () {58 vars in 1416 bytes} [Fri Aug 26 16:03:10 2022] DELETE /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3/os-volume_attachments/2527aeee-ed3c-48b4-aab7-f505292c0a30 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 16:03:10.525073 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-036668ef-6ab5-4e7e-86ed-c825a3831d2a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:10.527504 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-036668ef-6ab5-4e7e-86ed-c825a3831d2a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:10.529530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:03:10.534889 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-6167b389-b955-48d6-820b-f0c5390b872d tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/d54c84a0-fa93-4ccf-89bf-417c7049c522" status: 200 len: 286 microversion: 2.1 time: 0.035958 Aug 26 16:03:10.535541 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 490/959] 10.222.0.94 () {58 vars in 1251 bytes} [Fri Aug 26 16:03:10 2022] GET /compute/v2.1/os-snapshots/d54c84a0-fa93-4ccf-89bf-417c7049c522 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:03:10.539145 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-036668ef-6ab5-4e7e-86ed-c825a3831d2a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:10.539640 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-036668ef-6ab5-4e7e-86ed-c825a3831d2a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:10.540120 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-036668ef-6ab5-4e7e-86ed-c825a3831d2a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:10.540942 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-036668ef-6ab5-4e7e-86ed-c825a3831d2a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:10.541415 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-036668ef-6ab5-4e7e-86ed-c825a3831d2a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:10.541847 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-036668ef-6ab5-4e7e-86ed-c825a3831d2a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:10.573484 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-036668ef-6ab5-4e7e-86ed-c825a3831d2a tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053383 Aug 26 16:03:10.574286 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 470/960] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:03:10 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:03:11.547174 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-1975f707-2700-4180-a623-17c4c5e2bf9a tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] Calling method '.version_select at 0x7f15dcddc5e0>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:11.579479 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-1975f707-2700-4180-a623-17c4c5e2bf9a tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/d54c84a0-fa93-4ccf-89bf-417c7049c522" status: 200 len: 286 microversion: 2.1 time: 0.036610 Aug 26 16:03:11.580044 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 491/961] 10.222.0.94 () {58 vars in 1251 bytes} [Fri Aug 26 16:03:11 2022] GET /compute/v2.1/os-snapshots/d54c84a0-fa93-4ccf-89bf-417c7049c522 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:03:11.585628 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-68d3ee81-b5c8-4f3d-bd3e-47a051c1657b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:11.594087 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-68d3ee81-b5c8-4f3d-bd3e-47a051c1657b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:11.594604 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-68d3ee81-b5c8-4f3d-bd3e-47a051c1657b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:11.595113 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-68d3ee81-b5c8-4f3d-bd3e-47a051c1657b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:11.595544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-68d3ee81-b5c8-4f3d-bd3e-47a051c1657b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:11.596230 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-68d3ee81-b5c8-4f3d-bd3e-47a051c1657b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:11.596676 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-68d3ee81-b5c8-4f3d-bd3e-47a051c1657b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:11.597092 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-68d3ee81-b5c8-4f3d-bd3e-47a051c1657b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:11.626285 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-68d3ee81-b5c8-4f3d-bd3e-47a051c1657b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044553 Aug 26 16:03:11.626837 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 471/962] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:03:11 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:03:12.592697 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-eb69362b-6198-453e-80bc-64969f7810f3 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] Calling method '.version_select at 0x7f15dcd80310>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:12.625419 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-eb69362b-6198-453e-80bc-64969f7810f3 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/d54c84a0-fa93-4ccf-89bf-417c7049c522" status: 200 len: 286 microversion: 2.1 time: 0.036934 Aug 26 16:03:12.625993 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 492/963] 10.222.0.94 () {58 vars in 1251 bytes} [Fri Aug 26 16:03:12 2022] GET /compute/v2.1/os-snapshots/d54c84a0-fa93-4ccf-89bf-417c7049c522 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:03:12.639905 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-a9e4e553-0d2b-4f12-b6d1-f630db6b148d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:12.642033 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-a9e4e553-0d2b-4f12-b6d1-f630db6b148d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:12.648960 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a9e4e553-0d2b-4f12-b6d1-f630db6b148d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:12.649440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a9e4e553-0d2b-4f12-b6d1-f630db6b148d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:12.649925 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a9e4e553-0d2b-4f12-b6d1-f630db6b148d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:12.650609 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a9e4e553-0d2b-4f12-b6d1-f630db6b148d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:12.651160 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a9e4e553-0d2b-4f12-b6d1-f630db6b148d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:12.651582 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a9e4e553-0d2b-4f12-b6d1-f630db6b148d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:12.683414 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-a9e4e553-0d2b-4f12-b6d1-f630db6b148d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047629 Aug 26 16:03:12.683923 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 472/964] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:03:12 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:03:13.216085 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-db8770bc-992b-4133-b776-a75d258a9ca1 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:03:13.218408 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-db8770bc-992b-4133-b776-a75d258a9ca1 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:13.227335 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-db8770bc-992b-4133-b776-a75d258a9ca1 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:13.227829 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-db8770bc-992b-4133-b776-a75d258a9ca1 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:13.228266 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-db8770bc-992b-4133-b776-a75d258a9ca1 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:13.228959 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-db8770bc-992b-4133-b776-a75d258a9ca1 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:13.229411 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-db8770bc-992b-4133-b776-a75d258a9ca1 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:13.229836 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-db8770bc-992b-4133-b776-a75d258a9ca1 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:13.476668 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-db8770bc-992b-4133-b776-a75d258a9ca1 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "POST /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0/action" status: 202 len: 0 microversion: 2.1 time: 0.264360 Aug 26 16:03:13.477333 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 493/965] 10.222.0.94 () {60 vars in 1278 bytes} [Fri Aug 26 16:03:13 2022] POST /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 16:03:13.485471 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-fe08de81-e11d-4dbb-8186-322dfbc58aba tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:13.486117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-fe08de81-e11d-4dbb-8186-322dfbc58aba tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:13.492932 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fe08de81-e11d-4dbb-8186-322dfbc58aba tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:13.498231 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fe08de81-e11d-4dbb-8186-322dfbc58aba tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:13.498231 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fe08de81-e11d-4dbb-8186-322dfbc58aba tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:13.498231 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fe08de81-e11d-4dbb-8186-322dfbc58aba tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:13.498231 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fe08de81-e11d-4dbb-8186-322dfbc58aba tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:13.498610 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fe08de81-e11d-4dbb-8186-322dfbc58aba tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:13.638429 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-1195eb79-0191-48f0-a608-10222f3d7389 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] Calling method '.version_select at 0x7f15d95f68b0>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:13.643676 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-fe08de81-e11d-4dbb-8186-322dfbc58aba tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:13.653580 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-fe08de81-e11d-4dbb-8186-322dfbc58aba tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1752 microversion: 2.1 time: 0.171896 Aug 26 16:03:13.654948 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 473/966] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:13 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:03:13.671967 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-1195eb79-0191-48f0-a608-10222f3d7389 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/d54c84a0-fa93-4ccf-89bf-417c7049c522" status: 200 len: 287 microversion: 2.1 time: 0.038213 Aug 26 16:03:13.672533 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 494/967] 10.222.0.94 () {58 vars in 1251 bytes} [Fri Aug 26 16:03:13 2022] GET /compute/v2.1/os-snapshots/d54c84a0-fa93-4ccf-89bf-417c7049c522 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:03:13.684259 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-88631e70-022d-4864-8f8e-317a517f8452 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] Calling method '.version_select at 0x7f15d9678ee0>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:13.697331 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-4a3735ac-eac6-4ce9-9cfd-2f1a8e41d389 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:13.699703 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-4a3735ac-eac6-4ce9-9cfd-2f1a8e41d389 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:13.707703 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4a3735ac-eac6-4ce9-9cfd-2f1a8e41d389 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:13.708192 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4a3735ac-eac6-4ce9-9cfd-2f1a8e41d389 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:13.709113 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4a3735ac-eac6-4ce9-9cfd-2f1a8e41d389 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:13.709830 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4a3735ac-eac6-4ce9-9cfd-2f1a8e41d389 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:13.710452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4a3735ac-eac6-4ce9-9cfd-2f1a8e41d389 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:13.711101 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4a3735ac-eac6-4ce9-9cfd-2f1a8e41d389 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:13.744160 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-4a3735ac-eac6-4ce9-9cfd-2f1a8e41d389 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051566 Aug 26 16:03:13.744622 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 495/968] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:03:13 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:03:13.850638 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-88631e70-022d-4864-8f8e-317a517f8452 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] 10.222.0.94 "DELETE /compute/v2.1/os-snapshots/d54c84a0-fa93-4ccf-89bf-417c7049c522" status: 202 len: 0 microversion: 2.1 time: 0.170907 Aug 26 16:03:13.851243 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 474/969] 10.222.0.94 () {58 vars in 1254 bytes} [Fri Aug 26 16:03:13 2022] DELETE /compute/v2.1/os-snapshots/d54c84a0-fa93-4ccf-89bf-417c7049c522 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 16:03:13.859672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-7992f624-3b5e-4ad6-b152-775083c3ae99 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] Calling method '.version_select at 0x7f15d99dab80>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:13.890179 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-7992f624-3b5e-4ad6-b152-775083c3ae99 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/d54c84a0-fa93-4ccf-89bf-417c7049c522" status: 200 len: 286 microversion: 2.1 time: 0.034463 Aug 26 16:03:13.890951 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 496/970] 10.222.0.94 () {58 vars in 1251 bytes} [Fri Aug 26 16:03:13 2022] GET /compute/v2.1/os-snapshots/d54c84a0-fa93-4ccf-89bf-417c7049c522 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:03:14.680446 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f6385fd7-528c-448f-a715-50cdf98a32e5 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:14.681058 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-f6385fd7-528c-448f-a715-50cdf98a32e5 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:14.687983 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f6385fd7-528c-448f-a715-50cdf98a32e5 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:14.688469 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f6385fd7-528c-448f-a715-50cdf98a32e5 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:14.688933 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f6385fd7-528c-448f-a715-50cdf98a32e5 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:14.689687 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f6385fd7-528c-448f-a715-50cdf98a32e5 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:14.690146 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f6385fd7-528c-448f-a715-50cdf98a32e5 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:14.690573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f6385fd7-528c-448f-a715-50cdf98a32e5 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:14.757763 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-81bbeec4-4303-4df5-a172-26c55004665f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:14.759934 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-81bbeec4-4303-4df5-a172-26c55004665f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:14.766470 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-81bbeec4-4303-4df5-a172-26c55004665f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:14.767314 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-81bbeec4-4303-4df5-a172-26c55004665f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:14.767934 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-81bbeec4-4303-4df5-a172-26c55004665f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:14.768422 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-81bbeec4-4303-4df5-a172-26c55004665f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:14.768882 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-81bbeec4-4303-4df5-a172-26c55004665f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:14.769277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-81bbeec4-4303-4df5-a172-26c55004665f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:14.800011 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-81bbeec4-4303-4df5-a172-26c55004665f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047345 Aug 26 16:03:14.800615 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 497/971] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:03:14 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 26 16:03:14.835615 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-f6385fd7-528c-448f-a715-50cdf98a32e5 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:14.843984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-f6385fd7-528c-448f-a715-50cdf98a32e5 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1757 microversion: 2.1 time: 0.167903 Aug 26 16:03:14.844554 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 475/972] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:14 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:03:14.862384 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a1f5a63e-8869-4903-bdff-dca38a0f29e4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:14.862880 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a1f5a63e-8869-4903-bdff-dca38a0f29e4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:14.869082 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a1f5a63e-8869-4903-bdff-dca38a0f29e4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:14.869565 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a1f5a63e-8869-4903-bdff-dca38a0f29e4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:14.869995 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a1f5a63e-8869-4903-bdff-dca38a0f29e4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:14.870677 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a1f5a63e-8869-4903-bdff-dca38a0f29e4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:14.871165 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a1f5a63e-8869-4903-bdff-dca38a0f29e4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:14.871590 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a1f5a63e-8869-4903-bdff-dca38a0f29e4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:14.897888 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a1f5a63e-8869-4903-bdff-dca38a0f29e4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Going to try to terminate instance {{(pid=128305) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 16:03:14.903299 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-741ae50a-eb94-4073-ae37-3a31d5df3549 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] Calling method '.version_select at 0x7f15d9678310>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:14.929608 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-741ae50a-eb94-4073-ae37-3a31d5df3549 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] HTTP exception thrown: Snapshot d54c84a0-fa93-4ccf-89bf-417c7049c522 could not be found. Aug 26 16:03:14.932041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-741ae50a-eb94-4073-ae37-3a31d5df3549 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] Request method failure captured: Aug 26 16:03:14.932041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: GET /compute/v2.1/os-snapshots/d54c84a0-fa93-4ccf-89bf-417c7049c522 HTTP/1.1 Aug 26 16:03:14.932041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 16:03:14.932041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 16:03:14.932041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 16:03:14.932041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 0 Aug 26 16:03:14.932041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 16:03:14.932041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 16:03:14.932041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 16:03:14.932041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 16:03:14.932041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO66xogaXJ6CZREGuYht4U4BfbFWM-pYiyQpn9Gzd06ZTjNBEhYpnVB4G-DL3pBrYeWZ2ie-KGeywbzsO9t-AmoPRKvI7p-SFVVoqYu1_kHp4C6QRVZMvXW5Y2GJSSflr_JOHa91SWpBTCbp3BOMZAqpNUGUjWzSVKgrDExhrcVgPpQ Aug 26 16:03:14.932041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 16:03:14.932041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 16:03:14.932041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 16:03:14.932041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 16:03:14.932041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 16:03:14.932041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 16:03:14.932041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: 4084946ec94b47e6afa4940a3e322b8e Aug 26 16:03:14.932041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1222039396 Aug 26 16:03:14.932041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 16:03:14.932041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 16:03:14.933344 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/4084946ec94b47e6afa4940a3e322b8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/4084946ec94b47e6afa4940a3e322b8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/4084946ec94b47e6afa4940a3e322b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_4084946ec94b47e6afa4940a3e322b8e", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:03:14.933344 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1222039396 Aug 26 16:03:14.933344 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: 4084946ec94b47e6afa4940a3e322b8e Aug 26 16:03:14.933344 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1222039396 Aug 26 16:03:14.933344 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-VolumesSnapshotsTestJSON-1222039396-project Aug 26 16:03:14.933344 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 16:03:14.933344 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 16:03:14.933344 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: f33b855df2fb4a9da806dd0602bf9bf1 Aug 26 16:03:14.933344 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1222039396-project Aug 26 16:03:14.933344 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: Aug 26 16:03:14.933344 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Snapshot d54c84a0-fa93-4ccf-89bf-417c7049c522 could not be found. Aug 26 16:03:14.933344 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'id': 'd54c84a0-fa93-4ccf-89bf-417c7049c522'} Aug 26 16:03:14.933344 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:03:14.934171 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:03:14.934171 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 26 16:03:14.934171 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 26 16:03:14.934171 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 26 16:03:14.934171 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 26 16:03:14.934171 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 26 16:03:14.934171 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 26 16:03:14.934171 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 16:03:14.934171 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 16:03:14.934171 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 16:03:14.934171 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 16:03:14.934171 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 16:03:14.934171 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 16:03:14.934171 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 16:03:14.934171 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 16:03:14.934171 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d54c84a0-fa93-4ccf-89bf-417c7049c522 could not be found. (HTTP 404) (Request-ID: req-7598a366-9413-4481-aac5-f32b04a230de) Aug 26 16:03:14.934171 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:03:14.934171 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:03:14.935317 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:03:14.935317 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:03:14.935317 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 26 16:03:14.935317 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 26 16:03:14.935317 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 16:03:14.935317 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 16:03:14.935317 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 26 16:03:14.935317 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 26 16:03:14.935317 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 16:03:14.935317 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 16:03:14.935317 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 26 16:03:14.935317 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 26 16:03:14.935317 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 26 16:03:14.935317 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 26 16:03:14.935317 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 26 16:03:14.935317 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 26 16:03:14.935317 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 16:03:14.935317 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 16:03:14.935317 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 16:03:14.936486 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 16:03:14.936486 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 16:03:14.936486 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 16:03:14.936486 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 16:03:14.936486 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 16:03:14.936486 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d54c84a0-fa93-4ccf-89bf-417c7049c522 could not be found. Aug 26 16:03:14.936486 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:03:14.936486 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:03:14.936486 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:03:14.936486 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:03:14.936486 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:03:14.936486 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:03:14.936486 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:03:14.936486 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:03:14.936486 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 16:03:14.936486 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 16:03:14.936486 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:03:14.936486 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:03:14.936486 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 26 16:03:14.936486 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:03:14.937713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d54c84a0-fa93-4ccf-89bf-417c7049c522 could not be found. Aug 26 16:03:14.937713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:03:14.937713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:03:14.937713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:03:14.937713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:03:14.937713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:03:14.937713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:03:14.937713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:03:14.937713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:03:14.937713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d54c84a0-fa93-4ccf-89bf-417c7049c522 could not be found. Aug 26 16:03:14.937713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:03:14.937713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-741ae50a-eb94-4073-ae37-3a31d5df3549 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] Returning 404 to user: Snapshot d54c84a0-fa93-4ccf-89bf-417c7049c522 could not be found. {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:03:14.937713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-741ae50a-eb94-4073-ae37-3a31d5df3549 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/d54c84a0-fa93-4ccf-89bf-417c7049c522" status: 404 len: 111 microversion: 2.1 time: 0.034054 Aug 26 16:03:14.940451 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 476/973] 10.222.0.94 () {58 vars in 1251 bytes} [Fri Aug 26 16:03:14 2022] GET /compute/v2.1/os-snapshots/d54c84a0-fa93-4ccf-89bf-417c7049c522 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 16:03:14.942413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ba1b4f5c-6a77-4c6d-a5e6-3e029f436f66 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] Calling method '.version_select at 0x7f15d94ba280>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:15.245886 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ba1b4f5c-6a77-4c6d-a5e6-3e029f436f66 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] 10.222.0.94 "DELETE /compute/v2.1/os-volumes/20e2df9d-d5c6-41e4-b1d0-147f898f9db2" status: 202 len: 0 microversion: 2.1 time: 0.307321 Aug 26 16:03:15.246451 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 477/974] 10.222.0.94 () {58 vars in 1248 bytes} [Fri Aug 26 16:03:14 2022] DELETE /compute/v2.1/os-volumes/20e2df9d-d5c6-41e4-b1d0-147f898f9db2 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 16:03:15.254355 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ed91b9d6-b376-4275-85bf-b215153bd8b8 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] Calling method '.version_select at 0x7f15d9678b80>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:15.270259 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a1f5a63e-8869-4903-bdff-dca38a0f29e4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "DELETE /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 204 len: 0 microversion: 2.1 time: 0.411379 Aug 26 16:03:15.270845 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 498/975] 10.222.0.94 () {58 vars in 1239 bytes} [Fri Aug 26 16:03:14 2022] DELETE /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 16:03:15.280455 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-998599da-d387-4d38-973b-3c5aae173376 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:15.281222 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-998599da-d387-4d38-973b-3c5aae173376 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:15.288225 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-998599da-d387-4d38-973b-3c5aae173376 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:15.288727 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-998599da-d387-4d38-973b-3c5aae173376 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:15.289211 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-998599da-d387-4d38-973b-3c5aae173376 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:15.289912 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-998599da-d387-4d38-973b-3c5aae173376 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:15.290367 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-998599da-d387-4d38-973b-3c5aae173376 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:15.290792 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-998599da-d387-4d38-973b-3c5aae173376 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:15.306306 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ed91b9d6-b376-4275-85bf-b215153bd8b8 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/20e2df9d-d5c6-41e4-b1d0-147f898f9db2" status: 200 len: 344 microversion: 2.1 time: 0.055460 Aug 26 16:03:15.313100 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 478/976] 10.222.0.94 () {58 vars in 1245 bytes} [Fri Aug 26 16:03:15 2022] GET /compute/v2.1/os-volumes/20e2df9d-d5c6-41e4-b1d0-147f898f9db2 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:03:15.431607 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-998599da-d387-4d38-973b-3c5aae173376 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:15.435114 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:03:15.439615 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-998599da-d387-4d38-973b-3c5aae173376 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1680 microversion: 2.1 time: 0.163419 Aug 26 16:03:15.440170 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 499/977] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:15 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:03:15.864896 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-e704da20-4ef8-4a45-8db4-cf49bd8d4b50 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:15.865508 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-e704da20-4ef8-4a45-8db4-cf49bd8d4b50 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:15.872089 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e704da20-4ef8-4a45-8db4-cf49bd8d4b50 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:15.872569 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e704da20-4ef8-4a45-8db4-cf49bd8d4b50 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:15.873004 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e704da20-4ef8-4a45-8db4-cf49bd8d4b50 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:15.873696 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e704da20-4ef8-4a45-8db4-cf49bd8d4b50 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:15.874149 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e704da20-4ef8-4a45-8db4-cf49bd8d4b50 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:15.874664 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e704da20-4ef8-4a45-8db4-cf49bd8d4b50 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:16.013870 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e704da20-4ef8-4a45-8db4-cf49bd8d4b50 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:16.022270 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-e704da20-4ef8-4a45-8db4-cf49bd8d4b50 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1757 microversion: 2.1 time: 0.161671 Aug 26 16:03:16.023107 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 479/978] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:15 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:03:16.320912 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-6343d4fa-33cf-4f94-9f72-0d342f7a3daf tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] Calling method '.version_select at 0x7f15d9629b80>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:16.349468 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.wsgi [None req-6343d4fa-33cf-4f94-9f72-0d342f7a3daf tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] HTTP exception thrown: Volume 20e2df9d-d5c6-41e4-b1d0-147f898f9db2 could not be found. Aug 26 16:03:16.353302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-6343d4fa-33cf-4f94-9f72-0d342f7a3daf tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] Request method failure captured: Aug 26 16:03:16.353302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: request: GET /compute/v2.1/os-volumes/20e2df9d-d5c6-41e4-b1d0-147f898f9db2 HTTP/1.1 Aug 26 16:03:16.353302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept: application/json Aug 26 16:03:16.353302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept-Encoding: identity Aug 26 16:03:16.353302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Connection: close Aug 26 16:03:16.353302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Length: 0 Aug 26 16:03:16.353302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Type: application/json Aug 26 16:03:16.353302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Host: 10.222.0.94 Aug 26 16:03:16.353302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Openstack-System-Scope: None Aug 26 16:03:16.353302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: User-Agent: python-urllib3/1.26.11 Aug 26 16:03:16.353302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Auth-Token: gAAAAABjCO66xogaXJ6CZREGuYht4U4BfbFWM-pYiyQpn9Gzd06ZTjNBEhYpnVB4G-DL3pBrYeWZ2ie-KGeywbzsO9t-AmoPRKvI7p-SFVVoqYu1_kHp4C6QRVZMvXW5Y2GJSSflr_JOHa91SWpBTCbp3BOMZAqpNUGUjWzSVKgrDExhrcVgPpQ Aug 26 16:03:16.353302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Id: None Aug 26 16:03:16.353302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Name: None Aug 26 16:03:16.353302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Identity-Status: Confirmed Aug 26 16:03:16.353302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Is-Admin-Project: True Aug 26 16:03:16.353302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Id: default Aug 26 16:03:16.353302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Name: Default Aug 26 16:03:16.353302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Id: 4084946ec94b47e6afa4940a3e322b8e Aug 26 16:03:16.353302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1222039396 Aug 26 16:03:16.353302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Role: member,reader Aug 26 16:03:16.353302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Roles: member,reader Aug 26 16:03:16.354850 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/4084946ec94b47e6afa4940a3e322b8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/4084946ec94b47e6afa4940a3e322b8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/4084946ec94b47e6afa4940a3e322b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_4084946ec94b47e6afa4940a3e322b8e", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:03:16.354850 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1222039396 Aug 26 16:03:16.354850 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Id: 4084946ec94b47e6afa4940a3e322b8e Aug 26 16:03:16.354850 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1222039396 Aug 26 16:03:16.354850 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User: tempest-VolumesSnapshotsTestJSON-1222039396-project Aug 26 16:03:16.354850 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Id: default Aug 26 16:03:16.354850 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Name: Default Aug 26 16:03:16.354850 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Id: f33b855df2fb4a9da806dd0602bf9bf1 Aug 26 16:03:16.354850 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1222039396-project Aug 26 16:03:16.354850 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: method: Aug 26 16:03:16.354850 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: exception: Volume 20e2df9d-d5c6-41e4-b1d0-147f898f9db2 could not be found. Aug 26 16:03:16.354850 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: action_args: {'id': '20e2df9d-d5c6-41e4-b1d0-147f898f9db2'} Aug 26 16:03:16.354850 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:03:16.356032 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:03:16.356032 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 16:03:16.356032 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 16:03:16.356032 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 16:03:16.356032 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 16:03:16.356032 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 16:03:16.356032 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 16:03:16.356032 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 16:03:16.356032 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 16:03:16.356032 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 16:03:16.356032 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 16:03:16.356032 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 16:03:16.356032 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 16:03:16.356032 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 16:03:16.356032 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 16:03:16.356032 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 20e2df9d-d5c6-41e4-b1d0-147f898f9db2 could not be found. (HTTP 404) (Request-ID: req-b45f411b-96cf-4e02-b8e1-071cdf8635dc) Aug 26 16:03:16.356032 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:03:16.356032 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:03:16.356032 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:03:16.357348 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:03:16.357348 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 16:03:16.357348 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 16:03:16.357348 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 16:03:16.357348 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 16:03:16.357348 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 16:03:16.357348 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 16:03:16.357348 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 16:03:16.357348 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 16:03:16.357348 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 16:03:16.357348 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 16:03:16.357348 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 16:03:16.357348 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 16:03:16.357348 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 16:03:16.357348 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 16:03:16.357348 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 16:03:16.357348 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 16:03:16.357348 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 16:03:16.357348 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 16:03:16.358452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 16:03:16.358452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 16:03:16.358452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 16:03:16.358452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 16:03:16.358452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 20e2df9d-d5c6-41e4-b1d0-147f898f9db2 could not be found. Aug 26 16:03:16.358452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:03:16.358452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:03:16.358452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:03:16.358452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:03:16.358452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:03:16.358452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:03:16.358452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:03:16.358452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:03:16.358452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 16:03:16.358452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 16:03:16.358452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:03:16.358452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:03:16.358452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 16:03:16.358452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:03:16.359618 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 20e2df9d-d5c6-41e4-b1d0-147f898f9db2 could not be found. Aug 26 16:03:16.359618 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:03:16.359618 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:03:16.359618 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:03:16.359618 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:03:16.359618 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:03:16.359618 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:03:16.359618 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:03:16.359618 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:03:16.359618 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 20e2df9d-d5c6-41e4-b1d0-147f898f9db2 could not be found. Aug 26 16:03:16.359618 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:03:16.359618 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-6343d4fa-33cf-4f94-9f72-0d342f7a3daf tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] Returning 404 to user: Volume 20e2df9d-d5c6-41e4-b1d0-147f898f9db2 could not be found. {{(pid=128305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:03:16.359618 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-6343d4fa-33cf-4f94-9f72-0d342f7a3daf tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/20e2df9d-d5c6-41e4-b1d0-147f898f9db2" status: 404 len: 109 microversion: 2.1 time: 0.037905 Aug 26 16:03:16.359618 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 500/979] 10.222.0.94 () {58 vars in 1245 bytes} [Fri Aug 26 16:03:16 2022] GET /compute/v2.1/os-volumes/20e2df9d-d5c6-41e4-b1d0-147f898f9db2 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:03:16.369774 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-4bad2ce1-810d-4eab-8534-eb0a350a40b7 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] Calling method '.version_select at 0x7f15d9678ee0>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:16.397969 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-4bad2ce1-810d-4eab-8534-eb0a350a40b7 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] HTTP exception thrown: Volume 20e2df9d-d5c6-41e4-b1d0-147f898f9db2 could not be found. Aug 26 16:03:16.400005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-4bad2ce1-810d-4eab-8534-eb0a350a40b7 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] Request method failure captured: Aug 26 16:03:16.400005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: DELETE /compute/v2.1/os-volumes/20e2df9d-d5c6-41e4-b1d0-147f898f9db2 HTTP/1.1 Aug 26 16:03:16.400005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 16:03:16.400005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 16:03:16.400005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 16:03:16.400005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 0 Aug 26 16:03:16.400005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 16:03:16.400005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 16:03:16.400005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 16:03:16.400005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 16:03:16.400005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO66xogaXJ6CZREGuYht4U4BfbFWM-pYiyQpn9Gzd06ZTjNBEhYpnVB4G-DL3pBrYeWZ2ie-KGeywbzsO9t-AmoPRKvI7p-SFVVoqYu1_kHp4C6QRVZMvXW5Y2GJSSflr_JOHa91SWpBTCbp3BOMZAqpNUGUjWzSVKgrDExhrcVgPpQ Aug 26 16:03:16.400005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 16:03:16.400005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 16:03:16.400005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 16:03:16.400005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 16:03:16.400005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 16:03:16.400005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 16:03:16.400005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: 4084946ec94b47e6afa4940a3e322b8e Aug 26 16:03:16.400005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1222039396 Aug 26 16:03:16.400005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 16:03:16.400005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 16:03:16.401539 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/4084946ec94b47e6afa4940a3e322b8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/4084946ec94b47e6afa4940a3e322b8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/4084946ec94b47e6afa4940a3e322b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_4084946ec94b47e6afa4940a3e322b8e", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:03:16.401539 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1222039396 Aug 26 16:03:16.401539 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: 4084946ec94b47e6afa4940a3e322b8e Aug 26 16:03:16.401539 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1222039396 Aug 26 16:03:16.401539 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-VolumesSnapshotsTestJSON-1222039396-project Aug 26 16:03:16.401539 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 16:03:16.401539 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 16:03:16.401539 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: f33b855df2fb4a9da806dd0602bf9bf1 Aug 26 16:03:16.401539 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1222039396-project Aug 26 16:03:16.401539 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: Aug 26 16:03:16.401539 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Volume 20e2df9d-d5c6-41e4-b1d0-147f898f9db2 could not be found. Aug 26 16:03:16.401539 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'id': '20e2df9d-d5c6-41e4-b1d0-147f898f9db2'} Aug 26 16:03:16.401539 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:03:16.402454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:03:16.402454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 16:03:16.402454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 16:03:16.402454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 16:03:16.402454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 16:03:16.402454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 16:03:16.402454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 16:03:16.402454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 16:03:16.402454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 16:03:16.402454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 16:03:16.402454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 16:03:16.402454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 16:03:16.402454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 16:03:16.402454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 16:03:16.402454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 16:03:16.402454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 20e2df9d-d5c6-41e4-b1d0-147f898f9db2 could not be found. (HTTP 404) (Request-ID: req-53d01e6c-cfdd-4eea-aa87-4ccd5b7d1a8d) Aug 26 16:03:16.402454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:03:16.402454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:03:16.402454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:03:16.403867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:03:16.403867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 26 16:03:16.403867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 26 16:03:16.403867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 16:03:16.403867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 16:03:16.403867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 16:03:16.403867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 16:03:16.403867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 16:03:16.403867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 16:03:16.403867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 16:03:16.403867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 16:03:16.403867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 16:03:16.403867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 16:03:16.403867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 16:03:16.403867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 16:03:16.403867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 16:03:16.403867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 16:03:16.403867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 16:03:16.403867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 16:03:16.405204 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 16:03:16.405204 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 16:03:16.405204 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 16:03:16.405204 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 16:03:16.405204 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 20e2df9d-d5c6-41e4-b1d0-147f898f9db2 could not be found. Aug 26 16:03:16.405204 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:03:16.405204 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:03:16.405204 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:03:16.405204 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:03:16.405204 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:03:16.405204 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:03:16.405204 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:03:16.405204 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:03:16.405204 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 16:03:16.405204 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 16:03:16.405204 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:03:16.405204 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:03:16.405204 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 26 16:03:16.405204 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:03:16.406581 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 20e2df9d-d5c6-41e4-b1d0-147f898f9db2 could not be found. Aug 26 16:03:16.406581 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:03:16.406581 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:03:16.406581 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:03:16.406581 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:03:16.406581 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:03:16.406581 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:03:16.406581 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:03:16.406581 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:03:16.406581 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 20e2df9d-d5c6-41e4-b1d0-147f898f9db2 could not be found. Aug 26 16:03:16.406581 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:03:16.406581 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-4bad2ce1-810d-4eab-8534-eb0a350a40b7 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] Returning 404 to user: Volume 20e2df9d-d5c6-41e4-b1d0-147f898f9db2 could not be found. {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:03:16.406581 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-4bad2ce1-810d-4eab-8534-eb0a350a40b7 tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] 10.222.0.94 "DELETE /compute/v2.1/os-volumes/20e2df9d-d5c6-41e4-b1d0-147f898f9db2" status: 404 len: 109 microversion: 2.1 time: 0.036238 Aug 26 16:03:16.406581 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 480/980] 10.222.0.94 () {58 vars in 1248 bytes} [Fri Aug 26 16:03:16 2022] DELETE /compute/v2.1/os-volumes/20e2df9d-d5c6-41e4-b1d0-147f898f9db2 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:03:16.410285 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-98700fe8-921c-4948-a9b8-0d2657ed392f tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] Calling method '.version_select at 0x7f15d9680700>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:16.443049 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.wsgi [None req-98700fe8-921c-4948-a9b8-0d2657ed392f tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] HTTP exception thrown: Volume 20e2df9d-d5c6-41e4-b1d0-147f898f9db2 could not be found. Aug 26 16:03:16.445585 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-98700fe8-921c-4948-a9b8-0d2657ed392f tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] Request method failure captured: Aug 26 16:03:16.445585 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: request: GET /compute/v2.1/os-volumes/20e2df9d-d5c6-41e4-b1d0-147f898f9db2 HTTP/1.1 Aug 26 16:03:16.445585 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept: application/json Aug 26 16:03:16.445585 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept-Encoding: identity Aug 26 16:03:16.445585 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Connection: close Aug 26 16:03:16.445585 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Length: 0 Aug 26 16:03:16.445585 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Type: application/json Aug 26 16:03:16.445585 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Host: 10.222.0.94 Aug 26 16:03:16.445585 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Openstack-System-Scope: None Aug 26 16:03:16.445585 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: User-Agent: python-urllib3/1.26.11 Aug 26 16:03:16.445585 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Auth-Token: gAAAAABjCO66xogaXJ6CZREGuYht4U4BfbFWM-pYiyQpn9Gzd06ZTjNBEhYpnVB4G-DL3pBrYeWZ2ie-KGeywbzsO9t-AmoPRKvI7p-SFVVoqYu1_kHp4C6QRVZMvXW5Y2GJSSflr_JOHa91SWpBTCbp3BOMZAqpNUGUjWzSVKgrDExhrcVgPpQ Aug 26 16:03:16.445585 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Id: None Aug 26 16:03:16.445585 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Name: None Aug 26 16:03:16.445585 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Identity-Status: Confirmed Aug 26 16:03:16.445585 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Is-Admin-Project: True Aug 26 16:03:16.445585 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Id: default Aug 26 16:03:16.445585 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Name: Default Aug 26 16:03:16.445585 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Id: 4084946ec94b47e6afa4940a3e322b8e Aug 26 16:03:16.445585 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1222039396 Aug 26 16:03:16.445585 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Role: member,reader Aug 26 16:03:16.445585 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Roles: member,reader Aug 26 16:03:16.447130 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/4084946ec94b47e6afa4940a3e322b8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/4084946ec94b47e6afa4940a3e322b8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/4084946ec94b47e6afa4940a3e322b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_4084946ec94b47e6afa4940a3e322b8e", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:03:16.447130 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1222039396 Aug 26 16:03:16.447130 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Id: 4084946ec94b47e6afa4940a3e322b8e Aug 26 16:03:16.447130 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1222039396 Aug 26 16:03:16.447130 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User: tempest-VolumesSnapshotsTestJSON-1222039396-project Aug 26 16:03:16.447130 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Id: default Aug 26 16:03:16.447130 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Name: Default Aug 26 16:03:16.447130 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Id: f33b855df2fb4a9da806dd0602bf9bf1 Aug 26 16:03:16.447130 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1222039396-project Aug 26 16:03:16.447130 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: method: Aug 26 16:03:16.447130 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: exception: Volume 20e2df9d-d5c6-41e4-b1d0-147f898f9db2 could not be found. Aug 26 16:03:16.447130 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: action_args: {'id': '20e2df9d-d5c6-41e4-b1d0-147f898f9db2'} Aug 26 16:03:16.447130 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:03:16.448022 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:03:16.448022 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 16:03:16.448022 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 16:03:16.448022 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 16:03:16.448022 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 16:03:16.448022 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 16:03:16.448022 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 16:03:16.448022 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 16:03:16.448022 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 16:03:16.448022 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 16:03:16.448022 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 16:03:16.448022 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 16:03:16.448022 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 16:03:16.448022 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 16:03:16.448022 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 16:03:16.448022 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 20e2df9d-d5c6-41e4-b1d0-147f898f9db2 could not be found. (HTTP 404) (Request-ID: req-a4594e6c-c8fb-4d89-be96-4732e7ee2302) Aug 26 16:03:16.448022 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:03:16.448022 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:03:16.448022 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:03:16.449443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:03:16.449443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 16:03:16.449443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 16:03:16.449443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 16:03:16.449443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 16:03:16.449443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 16:03:16.449443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 16:03:16.449443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 16:03:16.449443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 16:03:16.449443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 16:03:16.449443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 16:03:16.449443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 16:03:16.449443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 16:03:16.449443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 16:03:16.449443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 16:03:16.449443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 16:03:16.449443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 16:03:16.449443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 16:03:16.449443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 16:03:16.450855 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 16:03:16.450855 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 16:03:16.450855 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 16:03:16.450855 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 16:03:16.450855 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 20e2df9d-d5c6-41e4-b1d0-147f898f9db2 could not be found. Aug 26 16:03:16.450855 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:03:16.450855 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:03:16.450855 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:03:16.450855 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:03:16.450855 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:03:16.450855 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:03:16.450855 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:03:16.450855 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:03:16.450855 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 16:03:16.450855 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 16:03:16.450855 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:03:16.450855 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:03:16.450855 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 16:03:16.450855 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:03:16.452260 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 20e2df9d-d5c6-41e4-b1d0-147f898f9db2 could not be found. Aug 26 16:03:16.452260 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:03:16.452260 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:03:16.452260 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:03:16.452260 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:03:16.452260 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:03:16.452260 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:03:16.452260 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:03:16.452260 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:03:16.452260 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 20e2df9d-d5c6-41e4-b1d0-147f898f9db2 could not be found. Aug 26 16:03:16.452260 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:03:16.452260 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-98700fe8-921c-4948-a9b8-0d2657ed392f tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] Returning 404 to user: Volume 20e2df9d-d5c6-41e4-b1d0-147f898f9db2 could not be found. {{(pid=128305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:03:16.452260 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-98700fe8-921c-4948-a9b8-0d2657ed392f tempest-VolumesSnapshotsTestJSON-1222039396 tempest-VolumesSnapshotsTestJSON-1222039396-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/20e2df9d-d5c6-41e4-b1d0-147f898f9db2" status: 404 len: 109 microversion: 2.1 time: 0.040666 Aug 26 16:03:16.452260 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 501/981] 10.222.0.94 () {58 vars in 1245 bytes} [Fri Aug 26 16:03:16 2022] GET /compute/v2.1/os-volumes/20e2df9d-d5c6-41e4-b1d0-147f898f9db2 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:03:16.460787 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-288ad4bc-bcad-41ec-9bd7-1d18bdcd4700 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:16.461410 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-288ad4bc-bcad-41ec-9bd7-1d18bdcd4700 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:16.468310 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-288ad4bc-bcad-41ec-9bd7-1d18bdcd4700 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:16.468827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-288ad4bc-bcad-41ec-9bd7-1d18bdcd4700 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:16.469266 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-288ad4bc-bcad-41ec-9bd7-1d18bdcd4700 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:16.469966 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-288ad4bc-bcad-41ec-9bd7-1d18bdcd4700 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:16.470424 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-288ad4bc-bcad-41ec-9bd7-1d18bdcd4700 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:16.470878 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-288ad4bc-bcad-41ec-9bd7-1d18bdcd4700 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:16.609571 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-288ad4bc-bcad-41ec-9bd7-1d18bdcd4700 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:16.617819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-288ad4bc-bcad-41ec-9bd7-1d18bdcd4700 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1680 microversion: 2.1 time: 0.160903 Aug 26 16:03:16.618430 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 481/982] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:16 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:03:17.045091 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-407d91ab-0faa-4b02-8e24-ec84a2e360f7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:17.045706 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-407d91ab-0faa-4b02-8e24-ec84a2e360f7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:17.053005 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-407d91ab-0faa-4b02-8e24-ec84a2e360f7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:17.054313 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-407d91ab-0faa-4b02-8e24-ec84a2e360f7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:17.054947 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-407d91ab-0faa-4b02-8e24-ec84a2e360f7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:17.055607 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-407d91ab-0faa-4b02-8e24-ec84a2e360f7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:17.056063 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-407d91ab-0faa-4b02-8e24-ec84a2e360f7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:17.056495 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-407d91ab-0faa-4b02-8e24-ec84a2e360f7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:17.258322 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-407d91ab-0faa-4b02-8e24-ec84a2e360f7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:17.268912 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-407d91ab-0faa-4b02-8e24-ec84a2e360f7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1757 microversion: 2.1 time: 0.227947 Aug 26 16:03:17.269487 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 502/983] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:17 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1757 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:03:17.641032 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-0d396ffc-d06f-479c-84c0-fc89b9f7965d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:17.642152 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-0d396ffc-d06f-479c-84c0-fc89b9f7965d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:17.653603 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0d396ffc-d06f-479c-84c0-fc89b9f7965d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:17.654099 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0d396ffc-d06f-479c-84c0-fc89b9f7965d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:17.654711 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0d396ffc-d06f-479c-84c0-fc89b9f7965d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:17.655640 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0d396ffc-d06f-479c-84c0-fc89b9f7965d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:17.656501 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0d396ffc-d06f-479c-84c0-fc89b9f7965d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:17.656936 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0d396ffc-d06f-479c-84c0-fc89b9f7965d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:17.908655 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-0d396ffc-d06f-479c-84c0-fc89b9f7965d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:17.917068 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-0d396ffc-d06f-479c-84c0-fc89b9f7965d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1680 microversion: 2.1 time: 0.281600 Aug 26 16:03:17.917671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 482/984] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:17 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1680 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:03:18.290574 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-4b7c3b02-1cfe-4784-8334-c2f9e624557d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:18.291227 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-4b7c3b02-1cfe-4784-8334-c2f9e624557d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:18.308713 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4b7c3b02-1cfe-4784-8334-c2f9e624557d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:18.313669 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4b7c3b02-1cfe-4784-8334-c2f9e624557d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:18.314838 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4b7c3b02-1cfe-4784-8334-c2f9e624557d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:18.316807 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4b7c3b02-1cfe-4784-8334-c2f9e624557d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:18.320395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4b7c3b02-1cfe-4784-8334-c2f9e624557d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:18.320395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4b7c3b02-1cfe-4784-8334-c2f9e624557d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:18.822715 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-4b7c3b02-1cfe-4784-8334-c2f9e624557d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:18.831022 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-4b7c3b02-1cfe-4784-8334-c2f9e624557d tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1757 microversion: 2.1 time: 0.545020 Aug 26 16:03:18.831520 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 503/985] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:18 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1757 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:03:18.938033 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-e12cd640-cbf4-47f9-b94b-221e10e7afcf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:18.938959 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-e12cd640-cbf4-47f9-b94b-221e10e7afcf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:18.948315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e12cd640-cbf4-47f9-b94b-221e10e7afcf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:18.950350 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e12cd640-cbf4-47f9-b94b-221e10e7afcf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:18.950350 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e12cd640-cbf4-47f9-b94b-221e10e7afcf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:18.950350 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e12cd640-cbf4-47f9-b94b-221e10e7afcf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:18.951409 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e12cd640-cbf4-47f9-b94b-221e10e7afcf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:18.951934 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e12cd640-cbf4-47f9-b94b-221e10e7afcf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:18.982602 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-2c8549c2-c374-4cbf-bbd0-bb8ba4242884 req-1e06ad63-2c39-4832-8ed3-2877e735a599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f241a343-9b6e-471f-9a18-964d506fe4f3", "name": "network-vif-deleted", "tag": "726f3f44-7d5b-426a-98ae-f35cdf9b45b9"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:03:18.999953 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-2c8549c2-c374-4cbf-bbd0-bb8ba4242884 req-1e06ad63-2c39-4832-8ed3-2877e735a599 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:19.000709 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-2c8549c2-c374-4cbf-bbd0-bb8ba4242884 req-1e06ad63-2c39-4832-8ed3-2877e735a599 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:19.001311 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-2c8549c2-c374-4cbf-bbd0-bb8ba4242884 req-1e06ad63-2c39-4832-8ed3-2877e735a599 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:19.014235 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-2c8549c2-c374-4cbf-bbd0-bb8ba4242884 req-1e06ad63-2c39-4832-8ed3-2877e735a599 service nova] Creating event network-vif-deleted:726f3f44-7d5b-426a-98ae-f35cdf9b45b9 for instance f241a343-9b6e-471f-9a18-964d506fe4f3 on hv-cinder-85144 Aug 26 16:03:19.020759 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-2c8549c2-c374-4cbf-bbd0-bb8ba4242884 req-1e06ad63-2c39-4832-8ed3-2877e735a599 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040501 Aug 26 16:03:19.020759 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 504/986] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:03:19.036261 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e12cd640-cbf4-47f9-b94b-221e10e7afcf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:19.046076 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-e12cd640-cbf4-47f9-b94b-221e10e7afcf tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1613 microversion: 2.1 time: 0.111627 Aug 26 16:03:19.059950 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 483/987] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:18 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1613 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:03:19.373117 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-31425a3a-cfdd-41af-8eb8-add17ee154a5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:19.373695 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-31425a3a-cfdd-41af-8eb8-add17ee154a5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:19.380689 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31425a3a-cfdd-41af-8eb8-add17ee154a5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:19.381250 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31425a3a-cfdd-41af-8eb8-add17ee154a5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:19.381946 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31425a3a-cfdd-41af-8eb8-add17ee154a5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:19.382941 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31425a3a-cfdd-41af-8eb8-add17ee154a5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:19.383465 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31425a3a-cfdd-41af-8eb8-add17ee154a5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:19.383989 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31425a3a-cfdd-41af-8eb8-add17ee154a5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:19.411287 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-31425a3a-cfdd-41af-8eb8-add17ee154a5 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f/ips" status: 200 len: 152 microversion: 2.20 time: 0.042714 Aug 26 16:03:19.412332 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 505/988] 10.222.0.94 () {60 vars in 1289 bytes} [Fri Aug 26 16:03:19 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f/ips => generated 152 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 16:03:19.853862 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ca57ecb2-fde3-42f9-af51-eed3dca611a7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:19.854610 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ca57ecb2-fde3-42f9-af51-eed3dca611a7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:19.860597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ca57ecb2-fde3-42f9-af51-eed3dca611a7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:19.862638 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ca57ecb2-fde3-42f9-af51-eed3dca611a7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:19.862638 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ca57ecb2-fde3-42f9-af51-eed3dca611a7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:19.862638 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ca57ecb2-fde3-42f9-af51-eed3dca611a7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:19.862989 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ca57ecb2-fde3-42f9-af51-eed3dca611a7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:19.863375 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ca57ecb2-fde3-42f9-af51-eed3dca611a7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:20.027890 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-ca57ecb2-fde3-42f9-af51-eed3dca611a7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:20.036605 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ca57ecb2-fde3-42f9-af51-eed3dca611a7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1757 microversion: 2.1 time: 0.187947 Aug 26 16:03:20.037638 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 484/989] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:19 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:03:20.074738 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-7fffd0fc-e327-4484-bba0-9ce60f798de5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:20.075532 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-7fffd0fc-e327-4484-bba0-9ce60f798de5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:20.079136 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=49,nova_api:UPDATE=2 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:03:20.090758 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7fffd0fc-e327-4484-bba0-9ce60f798de5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:20.091273 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7fffd0fc-e327-4484-bba0-9ce60f798de5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:20.091709 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7fffd0fc-e327-4484-bba0-9ce60f798de5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:20.092413 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7fffd0fc-e327-4484-bba0-9ce60f798de5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:20.092879 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7fffd0fc-e327-4484-bba0-9ce60f798de5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:20.093303 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7fffd0fc-e327-4484-bba0-9ce60f798de5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:20.132029 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7fffd0fc-e327-4484-bba0-9ce60f798de5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:20.132029 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7fffd0fc-e327-4484-bba0-9ce60f798de5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:20.132349 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7fffd0fc-e327-4484-bba0-9ce60f798de5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:20.135960 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-7fffd0fc-e327-4484-bba0-9ce60f798de5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lazy-loading 'fault' on Instance uuid f241a343-9b6e-471f-9a18-964d506fe4f3 {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:03:20.189799 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-7fffd0fc-e327-4484-bba0-9ce60f798de5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:20.201902 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-7fffd0fc-e327-4484-bba0-9ce60f798de5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 200 len: 1331 microversion: 2.1 time: 0.132784 Aug 26 16:03:20.202807 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 506/990] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:20 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 1331 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:03:21.058195 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-e02acd73-6f3a-4490-9d8a-e57ac0ee00da tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:21.058903 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-e02acd73-6f3a-4490-9d8a-e57ac0ee00da tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:21.065586 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e02acd73-6f3a-4490-9d8a-e57ac0ee00da tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:21.071235 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e02acd73-6f3a-4490-9d8a-e57ac0ee00da tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:21.071235 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e02acd73-6f3a-4490-9d8a-e57ac0ee00da tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:21.071235 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e02acd73-6f3a-4490-9d8a-e57ac0ee00da tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:21.071235 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e02acd73-6f3a-4490-9d8a-e57ac0ee00da tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:21.071742 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e02acd73-6f3a-4490-9d8a-e57ac0ee00da tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:21.073141 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:03:21.224853 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e02acd73-6f3a-4490-9d8a-e57ac0ee00da tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:21.231546 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a3a88082-e452-4ac8-a54c-8cc272205bc3 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:21.233745 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a3a88082-e452-4ac8-a54c-8cc272205bc3 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:21.234900 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-e02acd73-6f3a-4490-9d8a-e57ac0ee00da tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1757 microversion: 2.1 time: 0.181068 Aug 26 16:03:21.247100 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 485/991] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:21 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:03:21.258463 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a3a88082-e452-4ac8-a54c-8cc272205bc3 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:21.259114 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a3a88082-e452-4ac8-a54c-8cc272205bc3 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:21.259558 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a3a88082-e452-4ac8-a54c-8cc272205bc3 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:21.260272 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a3a88082-e452-4ac8-a54c-8cc272205bc3 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:21.260727 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a3a88082-e452-4ac8-a54c-8cc272205bc3 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:21.261154 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a3a88082-e452-4ac8-a54c-8cc272205bc3 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:21.275733 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.wsgi [None req-a3a88082-e452-4ac8-a54c-8cc272205bc3 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] HTTP exception thrown: Instance f241a343-9b6e-471f-9a18-964d506fe4f3 could not be found. Aug 26 16:03:21.277375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a3a88082-e452-4ac8-a54c-8cc272205bc3 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Request method failure captured: Aug 26 16:03:21.277375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: request: GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 HTTP/1.1 Aug 26 16:03:21.277375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept: application/json Aug 26 16:03:21.277375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept-Encoding: identity Aug 26 16:03:21.277375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Connection: close Aug 26 16:03:21.277375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Length: 0 Aug 26 16:03:21.277375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Type: application/json Aug 26 16:03:21.277375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Host: 10.222.0.94 Aug 26 16:03:21.277375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Openstack-System-Scope: None Aug 26 16:03:21.277375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: User-Agent: python-urllib3/1.26.11 Aug 26 16:03:21.277375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Auth-Token: gAAAAABjCO074Vk8Knkkyah_6hQlXk9FvzAhBqPeYMng3gGU-fQ_qYYEN-UvSDuAz2OG4j3gRVAyM63Qk6cGXT3e_LJrqtVIQ2Wh_rCIb7SpxdZF5G6vc_eR0N-2MIzlwTSdPywpn1m7Hkaqaj-3SiKQy1JcwWLQlfAR9RAjH6drO8qCv3BIADQ Aug 26 16:03:21.277375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Id: None Aug 26 16:03:21.277375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Name: None Aug 26 16:03:21.277375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Identity-Status: Confirmed Aug 26 16:03:21.277375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Is-Admin-Project: True Aug 26 16:03:21.277375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Id: default Aug 26 16:03:21.277375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Name: Default Aug 26 16:03:21.277375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Id: d95f731096d74a089f4161f5db69280c Aug 26 16:03:21.277375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Name: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:03:21.277375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Role: member,reader Aug 26 16:03:21.277375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Roles: member,reader Aug 26 16:03:21.279066 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/d95f731096d74a089f4161f5db69280c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/d95f731096d74a089f4161f5db69280c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/d95f731096d74a089f4161f5db69280c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_d95f731096d74a089f4161f5db69280c", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:03:21.279066 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:03:21.279066 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Id: d95f731096d74a089f4161f5db69280c Aug 26 16:03:21.279066 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:03:21.279066 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User: tempest-AttachVolumeNegativeTest-243089979-project Aug 26 16:03:21.279066 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Id: default Aug 26 16:03:21.279066 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Name: Default Aug 26 16:03:21.279066 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Id: b50041d36b0b430badd6442a2f09f063 Aug 26 16:03:21.279066 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Name: tempest-AttachVolumeNegativeTest-243089979-project Aug 26 16:03:21.279066 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: method: > Aug 26 16:03:21.279066 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: exception: Instance f241a343-9b6e-471f-9a18-964d506fe4f3 could not be found. Aug 26 16:03:21.279066 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: action_args: {'id': 'f241a343-9b6e-471f-9a18-964d506fe4f3'} Aug 26 16:03:21.279907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:03:21.279907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:03:21.279907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:03:21.279907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:03:21.279907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:03:21.279907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:03:21.279907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:03:21.279907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:03:21.279907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:03:21.279907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:03:21.279907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f241a343-9b6e-471f-9a18-964d506fe4f3 could not be found. Aug 26 16:03:21.279907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:03:21.279907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:03:21.279907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:03:21.279907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:03:21.279907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:03:21.279907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:03:21.279907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:03:21.279907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:03:21.279907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:03:21.281143 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:03:21.281143 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:03:21.281143 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:03:21.281143 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:03:21.281143 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:03:21.281143 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:03:21.281143 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:03:21.281143 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f241a343-9b6e-471f-9a18-964d506fe4f3 could not be found. Aug 26 16:03:21.281143 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:03:21.281143 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:03:21.281143 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:03:21.281143 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:03:21.281143 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:03:21.281143 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:03:21.281143 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:03:21.281143 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:03:21.281143 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f241a343-9b6e-471f-9a18-964d506fe4f3 could not be found. Aug 26 16:03:21.281143 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:03:21.282307 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a3a88082-e452-4ac8-a54c-8cc272205bc3 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Returning 404 to user: Instance f241a343-9b6e-471f-9a18-964d506fe4f3 could not be found. {{(pid=128305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:03:21.282307 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a3a88082-e452-4ac8-a54c-8cc272205bc3 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 404 len: 111 microversion: 2.1 time: 0.057660 Aug 26 16:03:21.282307 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 507/992] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:21 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:03:21.287647 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-36670bd6-d064-4c74-b6f9-fc8e6a513c59 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '.version_select at 0x7f15d971f790>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:21.416176 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-36670bd6-d064-4c74-b6f9-fc8e6a513c59 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320213866" status: 202 len: 0 microversion: 2.1 time: 0.132228 Aug 26 16:03:21.416763 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 486/993] 10.222.0.94 () {58 vars in 1221 bytes} [Fri Aug 26 16:03:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320213866 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 16:03:21.688939 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-004f345f-b496-4a33-8918-e9f074049076 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:03:21.689392 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-004f345f-b496-4a33-8918-e9f074049076 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:21.696572 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-004f345f-b496-4a33-8918-e9f074049076 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:21.697058 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-004f345f-b496-4a33-8918-e9f074049076 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:21.697494 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-004f345f-b496-4a33-8918-e9f074049076 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:21.698189 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-004f345f-b496-4a33-8918-e9f074049076 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:21.698637 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-004f345f-b496-4a33-8918-e9f074049076 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:21.704995 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-004f345f-b496-4a33-8918-e9f074049076 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:21.722145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-004f345f-b496-4a33-8918-e9f074049076 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lazy-loading 'flavor' on Instance uuid 3fc0c879-6083-414b-b6ee-2046538f526f {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:03:22.267344 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-5823b6b7-a5bd-46ec-8152-a114d41e1b42 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:22.268131 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-5823b6b7-a5bd-46ec-8152-a114d41e1b42 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:22.275281 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5823b6b7-a5bd-46ec-8152-a114d41e1b42 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:22.275870 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5823b6b7-a5bd-46ec-8152-a114d41e1b42 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:22.276368 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5823b6b7-a5bd-46ec-8152-a114d41e1b42 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:22.277124 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5823b6b7-a5bd-46ec-8152-a114d41e1b42 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:22.277698 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5823b6b7-a5bd-46ec-8152-a114d41e1b42 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:22.278182 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5823b6b7-a5bd-46ec-8152-a114d41e1b42 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:22.425696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-004f345f-b496-4a33-8918-e9f074049076 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "POST /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f/action" status: 202 len: 0 microversion: 2.20 time: 0.740942 Aug 26 16:03:22.426352 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 508/994] 10.222.0.94 () {62 vars in 1319 bytes} [Fri Aug 26 16:03:21 2022] POST /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f/action => generated 0 bytes in 742 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 16:03:22.430770 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-5823b6b7-a5bd-46ec-8152-a114d41e1b42 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:22.439500 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-5a96a0a0-0f0a-4b40-a18b-39df7dd1d0c4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Action: 'create', calling method: .version_select at 0x7f15d9621af0>, body: {"keypair": {"name": "tempest-keypair-89516204", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGr9+cjOcyHWVvd4DsPxUTW5UPfhkkuvjDU4hB2YPOgq0g+wIHRP97povk0tpXu1pLfVQK3uPos820kdob4lg/mirRAsda6ok1IE/l2R4szvU5W33TddDSmWGEo15U3KKQ=="}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:03:22.439722 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-5823b6b7-a5bd-46ec-8152-a114d41e1b42 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1757 microversion: 2.1 time: 0.177303 Aug 26 16:03:22.451122 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 487/995] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:22 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:03:22.451122 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7b235620-4ee9-4cd7-aef5-330ea9e22cfa tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:22.451122 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-7b235620-4ee9-4cd7-aef5-330ea9e22cfa tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:22.456305 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7b235620-4ee9-4cd7-aef5-330ea9e22cfa tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:22.456305 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7b235620-4ee9-4cd7-aef5-330ea9e22cfa tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:22.456305 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7b235620-4ee9-4cd7-aef5-330ea9e22cfa tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:22.456305 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7b235620-4ee9-4cd7-aef5-330ea9e22cfa tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:22.464063 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7b235620-4ee9-4cd7-aef5-330ea9e22cfa tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:22.464063 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7b235620-4ee9-4cd7-aef5-330ea9e22cfa tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:22.464231 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-5a96a0a0-0f0a-4b40-a18b-39df7dd1d0c4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Getting quotas for project d95f731096d74a089f4161f5db69280c. Resources: {'key_pairs'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 16:03:22.464231 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-5a96a0a0-0f0a-4b40-a18b-39df7dd1d0c4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Getting quotas for user b50041d36b0b430badd6442a2f09f063 and project d95f731096d74a089f4161f5db69280c. Resources: {'key_pairs'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 16:03:22.582406 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-5a96a0a0-0f0a-4b40-a18b-39df7dd1d0c4 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.154847 Aug 26 16:03:22.583041 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 509/996] 10.222.0.94 () {60 vars in 1159 bytes} [Fri Aug 26 16:03:22 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:03:22.619697 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7b235620-4ee9-4cd7-aef5-330ea9e22cfa tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:22.628347 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7b235620-4ee9-4cd7-aef5-330ea9e22cfa tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:22.629905 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7b235620-4ee9-4cd7-aef5-330ea9e22cfa tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:22.631208 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-7b235620-4ee9-4cd7-aef5-330ea9e22cfa tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1725 microversion: 2.20 time: 0.190060 Aug 26 16:03:22.632531 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 488/997] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:22 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:03:23.464468 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-cd2f285c-63c1-439f-85ef-32224866e001 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:23.467282 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-cd2f285c-63c1-439f-85ef-32224866e001 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:23.474017 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cd2f285c-63c1-439f-85ef-32224866e001 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:23.474584 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cd2f285c-63c1-439f-85ef-32224866e001 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:23.475204 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cd2f285c-63c1-439f-85ef-32224866e001 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:23.475994 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cd2f285c-63c1-439f-85ef-32224866e001 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:23.476531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cd2f285c-63c1-439f-85ef-32224866e001 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:23.477025 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cd2f285c-63c1-439f-85ef-32224866e001 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:23.654691 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-eb2d81f1-31c9-4913-9a6f-1774f233df3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:23.655512 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-eb2d81f1-31c9-4913-9a6f-1774f233df3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:23.662312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-eb2d81f1-31c9-4913-9a6f-1774f233df3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:23.663545 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-eb2d81f1-31c9-4913-9a6f-1774f233df3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:23.663983 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-eb2d81f1-31c9-4913-9a6f-1774f233df3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:23.665187 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-eb2d81f1-31c9-4913-9a6f-1774f233df3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:23.665775 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-eb2d81f1-31c9-4913-9a6f-1774f233df3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:23.666212 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-eb2d81f1-31c9-4913-9a6f-1774f233df3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:23.683113 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-cd2f285c-63c1-439f-85ef-32224866e001 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:23.699809 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-cd2f285c-63c1-439f-85ef-32224866e001 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1757 microversion: 2.1 time: 0.240402 Aug 26 16:03:23.702042 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 510/998] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:23 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1757 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:03:23.833719 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-eb2d81f1-31c9-4913-9a6f-1774f233df3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:23.842432 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-eb2d81f1-31c9-4913-9a6f-1774f233df3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:23.843777 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-eb2d81f1-31c9-4913-9a6f-1774f233df3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:23.844946 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-eb2d81f1-31c9-4913-9a6f-1774f233df3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1725 microversion: 2.20 time: 0.194352 Aug 26 16:03:23.845539 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 489/999] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:23 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:03:24.721130 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-7f527190-932c-4982-b755-fd4eb330ab8a tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:24.721743 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-7f527190-932c-4982-b755-fd4eb330ab8a tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:24.728314 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7f527190-932c-4982-b755-fd4eb330ab8a tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:24.728798 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7f527190-932c-4982-b755-fd4eb330ab8a tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:24.729230 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7f527190-932c-4982-b755-fd4eb330ab8a tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:24.729922 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7f527190-932c-4982-b755-fd4eb330ab8a tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:24.730555 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7f527190-932c-4982-b755-fd4eb330ab8a tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:24.731005 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7f527190-932c-4982-b755-fd4eb330ab8a tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:24.877691 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-43e94bf3-d787-419c-a0ec-0472d4862541 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:24.879367 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-43e94bf3-d787-419c-a0ec-0472d4862541 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:24.891185 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-43e94bf3-d787-419c-a0ec-0472d4862541 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:24.892102 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-43e94bf3-d787-419c-a0ec-0472d4862541 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:24.893581 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-43e94bf3-d787-419c-a0ec-0472d4862541 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:24.895092 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-43e94bf3-d787-419c-a0ec-0472d4862541 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:24.895216 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-7f527190-932c-4982-b755-fd4eb330ab8a tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:24.896726 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-43e94bf3-d787-419c-a0ec-0472d4862541 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:24.897888 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-43e94bf3-d787-419c-a0ec-0472d4862541 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:24.903970 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-7f527190-932c-4982-b755-fd4eb330ab8a tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1757 microversion: 2.1 time: 0.186571 Aug 26 16:03:24.918346 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 511/1000] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:24 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1757 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:03:25.044039 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-43e94bf3-d787-419c-a0ec-0472d4862541 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:25.052926 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-43e94bf3-d787-419c-a0ec-0472d4862541 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:25.055417 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-43e94bf3-d787-419c-a0ec-0472d4862541 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:25.057090 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-43e94bf3-d787-419c-a0ec-0472d4862541 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1725 microversion: 2.20 time: 0.190813 Aug 26 16:03:25.057646 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 490/1001] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:24 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:03:25.306874 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-41bade3a-2ce4-4b86-a80e-e3e98f55764e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1344594351", "imageRef": "bcbdbb0c-7335-4427-a636-e2dc730274b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62414327-5b31-4d4a-b372-9a9bbc06aa9d"}], "security_groups": [{"name": "tempest-securitygroup--967039703"}], "key_name": "tempest-keypair-89516204", "user_data": "}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:03:25.415812 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.network.neutron [None req-41bade3a-2ce4-4b86-a80e-e3e98f55764e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] validate_networks() for [('62414327-5b31-4d4a-b372-9a9bbc06aa9d', None, None, None, None, None)] {{(pid=128305) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 16:03:25.797363 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-41bade3a-2ce4-4b86-a80e-e3e98f55764e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Flavor limits 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 16:03:25.797948 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-41bade3a-2ce4-4b86-a80e-e3e98f55764e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Image limits 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 16:03:25.798240 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-41bade3a-2ce4-4b86-a80e-e3e98f55764e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Flavor pref 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 16:03:25.798644 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-41bade3a-2ce4-4b86-a80e-e3e98f55764e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Image pref 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 16:03:25.799143 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-41bade3a-2ce4-4b86-a80e-e3e98f55764e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 16:03:25.808653 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-41bade3a-2ce4-4b86-a80e-e3e98f55764e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:25.809138 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-41bade3a-2ce4-4b86-a80e-e3e98f55764e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:25.809582 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-41bade3a-2ce4-4b86-a80e-e3e98f55764e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:25.810310 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-41bade3a-2ce4-4b86-a80e-e3e98f55764e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:25.810762 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-41bade3a-2ce4-4b86-a80e-e3e98f55764e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:25.811214 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-41bade3a-2ce4-4b86-a80e-e3e98f55764e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:25.829492 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-41bade3a-2ce4-4b86-a80e-e3e98f55764e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Getting quotas for project d95f731096d74a089f4161f5db69280c. Resources: {'instances', 'ram', 'cores'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 16:03:25.833955 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-41bade3a-2ce4-4b86-a80e-e3e98f55764e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Getting quotas for user b50041d36b0b430badd6442a2f09f063 and project d95f731096d74a089f4161f5db69280c. Resources: {'instances', 'ram', 'cores'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 16:03:25.846615 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-41bade3a-2ce4-4b86-a80e-e3e98f55764e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Going to run 1 instances... {{(pid=128305) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 16:03:25.848974 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-41bade3a-2ce4-4b86-a80e-e3e98f55764e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bcbdbb0c-7335-4427-a636-e2dc730274b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128305) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 16:03:25.925593 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-69dd2e4b-41eb-4af0-9559-e1860705a110 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:25.926315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-69dd2e4b-41eb-4af0-9559-e1860705a110 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:25.933037 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-69dd2e4b-41eb-4af0-9559-e1860705a110 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:25.933629 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-69dd2e4b-41eb-4af0-9559-e1860705a110 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:25.934145 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-69dd2e4b-41eb-4af0-9559-e1860705a110 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:25.935030 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-69dd2e4b-41eb-4af0-9559-e1860705a110 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:25.935581 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-69dd2e4b-41eb-4af0-9559-e1860705a110 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:25.936080 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-69dd2e4b-41eb-4af0-9559-e1860705a110 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:26.049115 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-41bade3a-2ce4-4b86-a80e-e3e98f55764e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.746991 Aug 26 16:03:26.050242 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 512/1002] 10.222.0.94 () {60 vars in 1147 bytes} [Fri Aug 26 16:03:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 16:03:26.067267 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-45c8df15-608a-4144-8d25-19d30a5456bd tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:26.067267 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-45c8df15-608a-4144-8d25-19d30a5456bd tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:26.092081 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-69dd2e4b-41eb-4af0-9559-e1860705a110 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:26.100834 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-69dd2e4b-41eb-4af0-9559-e1860705a110 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1757 microversion: 2.1 time: 0.179054 Aug 26 16:03:26.101408 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 491/1003] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:25 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:03:26.106630 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-8ed01514-ee10-4f2b-8235-0813107d77d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:26.107542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-8ed01514-ee10-4f2b-8235-0813107d77d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:26.116074 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8ed01514-ee10-4f2b-8235-0813107d77d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:26.116903 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8ed01514-ee10-4f2b-8235-0813107d77d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:26.117574 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8ed01514-ee10-4f2b-8235-0813107d77d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:26.118469 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8ed01514-ee10-4f2b-8235-0813107d77d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:26.119319 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8ed01514-ee10-4f2b-8235-0813107d77d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:26.119911 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8ed01514-ee10-4f2b-8235-0813107d77d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:26.131638 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-45c8df15-608a-4144-8d25-19d30a5456bd tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:26.143656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-45c8df15-608a-4144-8d25-19d30a5456bd tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154" status: 200 len: 1240 microversion: 2.1 time: 0.086364 Aug 26 16:03:26.144298 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 513/1004] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:26 2022] GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:03:26.264198 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-8ed01514-ee10-4f2b-8235-0813107d77d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:26.272597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-8ed01514-ee10-4f2b-8235-0813107d77d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:26.274815 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-8ed01514-ee10-4f2b-8235-0813107d77d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:26.276288 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-8ed01514-ee10-4f2b-8235-0813107d77d6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1725 microversion: 2.20 time: 0.173486 Aug 26 16:03:26.280414 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 492/1005] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:26 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:03:27.123060 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-379f7573-db63-4547-b645-d56ed1f94f9f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:27.123675 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-379f7573-db63-4547-b645-d56ed1f94f9f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:27.130278 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-379f7573-db63-4547-b645-d56ed1f94f9f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:27.130758 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-379f7573-db63-4547-b645-d56ed1f94f9f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:27.131222 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-379f7573-db63-4547-b645-d56ed1f94f9f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:27.131909 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-379f7573-db63-4547-b645-d56ed1f94f9f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:27.132509 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-379f7573-db63-4547-b645-d56ed1f94f9f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:27.132936 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-379f7573-db63-4547-b645-d56ed1f94f9f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:27.166462 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-b8f3279f-2eff-4f8c-aba3-71ea3866c2aa tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:27.167055 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-b8f3279f-2eff-4f8c-aba3-71ea3866c2aa tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:27.173527 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b8f3279f-2eff-4f8c-aba3-71ea3866c2aa tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:27.174005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b8f3279f-2eff-4f8c-aba3-71ea3866c2aa tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:27.174489 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b8f3279f-2eff-4f8c-aba3-71ea3866c2aa tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:27.175207 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b8f3279f-2eff-4f8c-aba3-71ea3866c2aa tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:27.175860 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b8f3279f-2eff-4f8c-aba3-71ea3866c2aa tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:27.176446 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b8f3279f-2eff-4f8c-aba3-71ea3866c2aa tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:27.239780 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-b8f3279f-2eff-4f8c-aba3-71ea3866c2aa tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:27.247339 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-b8f3279f-2eff-4f8c-aba3-71ea3866c2aa tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154" status: 200 len: 1244 microversion: 2.1 time: 0.085676 Aug 26 16:03:27.247897 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 493/1006] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:27 2022] GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:03:27.298228 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-fff33062-d735-4bab-8281-62efbc2d6f14 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:27.298833 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-fff33062-d735-4bab-8281-62efbc2d6f14 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:27.304835 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fff33062-d735-4bab-8281-62efbc2d6f14 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:27.305317 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fff33062-d735-4bab-8281-62efbc2d6f14 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:27.305750 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fff33062-d735-4bab-8281-62efbc2d6f14 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:27.306443 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fff33062-d735-4bab-8281-62efbc2d6f14 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:27.306895 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fff33062-d735-4bab-8281-62efbc2d6f14 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:27.307347 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-fff33062-d735-4bab-8281-62efbc2d6f14 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:27.472773 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-379f7573-db63-4547-b645-d56ed1f94f9f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:27.488411 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-fff33062-d735-4bab-8281-62efbc2d6f14 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:27.493234 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-379f7573-db63-4547-b645-d56ed1f94f9f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1757 microversion: 2.1 time: 0.365810 Aug 26 16:03:27.493234 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 514/1007] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:27 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1757 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:03:27.508778 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-fff33062-d735-4bab-8281-62efbc2d6f14 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:27.510428 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-fff33062-d735-4bab-8281-62efbc2d6f14 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:27.511636 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-fff33062-d735-4bab-8281-62efbc2d6f14 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1725 microversion: 2.20 time: 0.217198 Aug 26 16:03:27.512201 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 494/1008] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:27 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:03:28.267770 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-8362316f-2a5d-4c06-bde2-1bb1b88a58a1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:28.268383 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-8362316f-2a5d-4c06-bde2-1bb1b88a58a1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:28.275730 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8362316f-2a5d-4c06-bde2-1bb1b88a58a1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:28.276218 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8362316f-2a5d-4c06-bde2-1bb1b88a58a1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:28.278056 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8362316f-2a5d-4c06-bde2-1bb1b88a58a1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:28.278056 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8362316f-2a5d-4c06-bde2-1bb1b88a58a1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:28.278056 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8362316f-2a5d-4c06-bde2-1bb1b88a58a1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:28.278361 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8362316f-2a5d-4c06-bde2-1bb1b88a58a1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:28.341339 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-8362316f-2a5d-4c06-bde2-1bb1b88a58a1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:28.348965 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-8362316f-2a5d-4c06-bde2-1bb1b88a58a1 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154" status: 200 len: 1292 microversion: 2.1 time: 0.084963 Aug 26 16:03:28.349535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 515/1009] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:28 2022] GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154 => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:03:28.513556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-c727b67f-bb82-4aba-8431-3a7dbfb6d5f3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:28.518045 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-c727b67f-bb82-4aba-8431-3a7dbfb6d5f3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:28.520664 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c727b67f-bb82-4aba-8431-3a7dbfb6d5f3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:28.521152 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c727b67f-bb82-4aba-8431-3a7dbfb6d5f3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:28.521588 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c727b67f-bb82-4aba-8431-3a7dbfb6d5f3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:28.522287 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c727b67f-bb82-4aba-8431-3a7dbfb6d5f3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:28.522742 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c727b67f-bb82-4aba-8431-3a7dbfb6d5f3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:28.523197 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c727b67f-bb82-4aba-8431-3a7dbfb6d5f3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:28.535433 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-8e455f86-b30a-4c01-b641-db661ee249a7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:28.536085 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-8e455f86-b30a-4c01-b641-db661ee249a7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:28.543650 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8e455f86-b30a-4c01-b641-db661ee249a7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:28.546250 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8e455f86-b30a-4c01-b641-db661ee249a7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:28.546250 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8e455f86-b30a-4c01-b641-db661ee249a7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:28.546250 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8e455f86-b30a-4c01-b641-db661ee249a7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:28.546250 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8e455f86-b30a-4c01-b641-db661ee249a7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:28.546606 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8e455f86-b30a-4c01-b641-db661ee249a7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:28.807725 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-c727b67f-bb82-4aba-8431-3a7dbfb6d5f3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:28.817095 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-c727b67f-bb82-4aba-8431-3a7dbfb6d5f3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1757 microversion: 2.1 time: 0.307558 Aug 26 16:03:28.817756 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 495/1010] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:28 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1757 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:03:28.825617 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-8e455f86-b30a-4c01-b641-db661ee249a7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:28.835744 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-8e455f86-b30a-4c01-b641-db661ee249a7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:28.839129 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-8e455f86-b30a-4c01-b641-db661ee249a7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:28.840677 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-8e455f86-b30a-4c01-b641-db661ee249a7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1725 microversion: 2.20 time: 0.309269 Aug 26 16:03:28.850010 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 516/1011] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:28 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1725 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:03:29.370224 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-6ec1a966-5d30-49ca-9168-f182ae7d073e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:29.370833 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-6ec1a966-5d30-49ca-9168-f182ae7d073e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:29.376878 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ec1a966-5d30-49ca-9168-f182ae7d073e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:29.377361 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ec1a966-5d30-49ca-9168-f182ae7d073e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:29.377797 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ec1a966-5d30-49ca-9168-f182ae7d073e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:29.378486 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ec1a966-5d30-49ca-9168-f182ae7d073e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:29.378954 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ec1a966-5d30-49ca-9168-f182ae7d073e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:29.379392 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6ec1a966-5d30-49ca-9168-f182ae7d073e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:29.455544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-6ec1a966-5d30-49ca-9168-f182ae7d073e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:29.464759 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-6ec1a966-5d30-49ca-9168-f182ae7d073e tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154" status: 200 len: 1298 microversion: 2.1 time: 0.098646 Aug 26 16:03:29.465413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 496/1012] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:29 2022] GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154 => generated 1298 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:03:29.839506 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-fd872058-ecfa-420c-a31a-20be996669cd tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:29.840146 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-fd872058-ecfa-420c-a31a-20be996669cd tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:29.846853 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fd872058-ecfa-420c-a31a-20be996669cd tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:29.847364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fd872058-ecfa-420c-a31a-20be996669cd tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:29.847799 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fd872058-ecfa-420c-a31a-20be996669cd tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:29.848487 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fd872058-ecfa-420c-a31a-20be996669cd tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:29.848933 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fd872058-ecfa-420c-a31a-20be996669cd tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:29.849354 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fd872058-ecfa-420c-a31a-20be996669cd tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:29.865641 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-264076ac-bae7-4e25-83d7-841ff8341049 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:29.866340 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-264076ac-bae7-4e25-83d7-841ff8341049 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:29.874417 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-264076ac-bae7-4e25-83d7-841ff8341049 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:29.874543 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-264076ac-bae7-4e25-83d7-841ff8341049 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:29.874993 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-264076ac-bae7-4e25-83d7-841ff8341049 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:29.875708 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-264076ac-bae7-4e25-83d7-841ff8341049 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:29.876176 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-264076ac-bae7-4e25-83d7-841ff8341049 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:29.876607 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-264076ac-bae7-4e25-83d7-841ff8341049 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:30.169667 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-fd872058-ecfa-420c-a31a-20be996669cd tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:30.177922 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-fd872058-ecfa-420c-a31a-20be996669cd tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1757 microversion: 2.1 time: 0.342583 Aug 26 16:03:30.185060 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 517/1013] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:29 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1757 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:03:30.185256 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-264076ac-bae7-4e25-83d7-841ff8341049 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:30.191839 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-264076ac-bae7-4e25-83d7-841ff8341049 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:30.193891 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-264076ac-bae7-4e25-83d7-841ff8341049 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:30.195092 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-264076ac-bae7-4e25-83d7-841ff8341049 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1725 microversion: 2.20 time: 0.333283 Aug 26 16:03:30.195880 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 497/1014] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:29 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1725 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:03:30.485554 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-c640f598-a1bc-4948-9503-a169e8e27f16 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:30.486159 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-c640f598-a1bc-4948-9503-a169e8e27f16 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:30.493815 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c640f598-a1bc-4948-9503-a169e8e27f16 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:30.494353 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c640f598-a1bc-4948-9503-a169e8e27f16 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:30.495038 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c640f598-a1bc-4948-9503-a169e8e27f16 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:30.495858 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c640f598-a1bc-4948-9503-a169e8e27f16 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:30.496316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c640f598-a1bc-4948-9503-a169e8e27f16 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:30.496747 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c640f598-a1bc-4948-9503-a169e8e27f16 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:30.718732 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-c640f598-a1bc-4948-9503-a169e8e27f16 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:30.727284 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-c640f598-a1bc-4948-9503-a169e8e27f16 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154" status: 200 len: 1365 microversion: 2.1 time: 0.245460 Aug 26 16:03:30.727927 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 518/1015] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:30 2022] GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154 => generated 1365 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:03:30.932940 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-eb00ce86-45e1-4a32-bb12-e50310b01cb3 req-75892508-24da-4f76-abf6-f728a47c2127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "579627a3-5e3e-40c0-be7a-c333ee8ee154", "tag": "fb610a76-d6cc-4bcd-be95-56a4a36620ad"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:03:30.947503 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-eb00ce86-45e1-4a32-bb12-e50310b01cb3 req-75892508-24da-4f76-abf6-f728a47c2127 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:30.948193 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-eb00ce86-45e1-4a32-bb12-e50310b01cb3 req-75892508-24da-4f76-abf6-f728a47c2127 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:30.948702 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-eb00ce86-45e1-4a32-bb12-e50310b01cb3 req-75892508-24da-4f76-abf6-f728a47c2127 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:30.959741 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-eb00ce86-45e1-4a32-bb12-e50310b01cb3 req-75892508-24da-4f76-abf6-f728a47c2127 service nova] Creating event network-changed:fb610a76-d6cc-4bcd-be95-56a4a36620ad for instance 579627a3-5e3e-40c0-be7a-c333ee8ee154 on hv-cinder-85144 Aug 26 16:03:30.965342 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-eb00ce86-45e1-4a32-bb12-e50310b01cb3 req-75892508-24da-4f76-abf6-f728a47c2127 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036155 Aug 26 16:03:30.966001 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 498/1016] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:03:31.201045 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-4e472622-ff91-45a8-9072-76e042f248f6 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:31.201652 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-4e472622-ff91-45a8-9072-76e042f248f6 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:31.208326 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4e472622-ff91-45a8-9072-76e042f248f6 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:31.210858 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4e472622-ff91-45a8-9072-76e042f248f6 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:31.210858 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4e472622-ff91-45a8-9072-76e042f248f6 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:31.210858 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4e472622-ff91-45a8-9072-76e042f248f6 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:31.210858 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4e472622-ff91-45a8-9072-76e042f248f6 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:31.212001 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4e472622-ff91-45a8-9072-76e042f248f6 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:31.220811 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f40bec26-cccf-4ccd-a384-7b5f907a646f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:31.221762 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-f40bec26-cccf-4ccd-a384-7b5f907a646f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:31.230195 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f40bec26-cccf-4ccd-a384-7b5f907a646f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:31.230977 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f40bec26-cccf-4ccd-a384-7b5f907a646f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:31.231732 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f40bec26-cccf-4ccd-a384-7b5f907a646f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:31.232660 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f40bec26-cccf-4ccd-a384-7b5f907a646f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:31.233354 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f40bec26-cccf-4ccd-a384-7b5f907a646f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:31.233962 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f40bec26-cccf-4ccd-a384-7b5f907a646f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:31.499860 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-f40bec26-cccf-4ccd-a384-7b5f907a646f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:31.508418 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-f40bec26-cccf-4ccd-a384-7b5f907a646f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:31.509927 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-f40bec26-cccf-4ccd-a384-7b5f907a646f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:31.511167 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-f40bec26-cccf-4ccd-a384-7b5f907a646f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1725 microversion: 2.20 time: 0.295644 Aug 26 16:03:31.511764 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 499/1017] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:31 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1725 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:03:31.514941 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-4e472622-ff91-45a8-9072-76e042f248f6 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:31.525185 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-4e472622-ff91-45a8-9072-76e042f248f6 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1760 microversion: 2.1 time: 0.328417 Aug 26 16:03:31.534344 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 519/1018] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:31 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1760 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:03:31.748060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7082aeab-33d1-44f3-858a-cba435610184 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:31.748935 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-7082aeab-33d1-44f3-858a-cba435610184 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:31.755589 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7082aeab-33d1-44f3-858a-cba435610184 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:31.756225 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7082aeab-33d1-44f3-858a-cba435610184 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:31.756677 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7082aeab-33d1-44f3-858a-cba435610184 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:31.757580 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7082aeab-33d1-44f3-858a-cba435610184 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:31.758649 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7082aeab-33d1-44f3-858a-cba435610184 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:31.759195 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7082aeab-33d1-44f3-858a-cba435610184 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:31.971932 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7082aeab-33d1-44f3-858a-cba435610184 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:31.980191 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-7082aeab-33d1-44f3-858a-cba435610184 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154" status: 200 len: 1365 microversion: 2.1 time: 0.235888 Aug 26 16:03:31.980783 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 500/1019] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:31 2022] GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:03:32.213259 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-769fa8c5-a8de-43ad-883a-586899f6fa5b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:32.213807 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-769fa8c5-a8de-43ad-883a-586899f6fa5b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:32.220473 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-769fa8c5-a8de-43ad-883a-586899f6fa5b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:32.220899 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-769fa8c5-a8de-43ad-883a-586899f6fa5b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:32.221341 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-769fa8c5-a8de-43ad-883a-586899f6fa5b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:32.222035 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-769fa8c5-a8de-43ad-883a-586899f6fa5b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:32.222494 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-769fa8c5-a8de-43ad-883a-586899f6fa5b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:32.222944 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-769fa8c5-a8de-43ad-883a-586899f6fa5b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:32.241123 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:03:32.248391 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-769fa8c5-a8de-43ad-883a-586899f6fa5b tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff/ips" status: 200 len: 144 microversion: 2.1 time: 0.039349 Aug 26 16:03:32.248949 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 520/1020] 10.222.0.94 () {58 vars in 1248 bytes} [Fri Aug 26 16:03:32 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff/ips => generated 144 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:03:32.535348 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-84f1e7e5-6e71-43a4-9925-c5f4547c64c1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:32.536027 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-84f1e7e5-6e71-43a4-9925-c5f4547c64c1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:32.542379 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-84f1e7e5-6e71-43a4-9925-c5f4547c64c1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:32.542853 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-84f1e7e5-6e71-43a4-9925-c5f4547c64c1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:32.543311 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-84f1e7e5-6e71-43a4-9925-c5f4547c64c1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:32.543994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-84f1e7e5-6e71-43a4-9925-c5f4547c64c1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:32.544472 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-84f1e7e5-6e71-43a4-9925-c5f4547c64c1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:32.544892 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-84f1e7e5-6e71-43a4-9925-c5f4547c64c1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:32.677888 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-84f1e7e5-6e71-43a4-9925-c5f4547c64c1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:32.686861 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-84f1e7e5-6e71-43a4-9925-c5f4547c64c1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:32.688324 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-84f1e7e5-6e71-43a4-9925-c5f4547c64c1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:32.689472 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-84f1e7e5-6e71-43a4-9925-c5f4547c64c1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1725 microversion: 2.20 time: 0.158015 Aug 26 16:03:32.690030 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 501/1021] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:32 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:03:33.003010 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-cffc137d-0da9-4ecc-9ccf-23d3f93f2678 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:33.003681 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-cffc137d-0da9-4ecc-9ccf-23d3f93f2678 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:33.010696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cffc137d-0da9-4ecc-9ccf-23d3f93f2678 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:33.011190 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cffc137d-0da9-4ecc-9ccf-23d3f93f2678 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:33.011615 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cffc137d-0da9-4ecc-9ccf-23d3f93f2678 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:33.012299 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cffc137d-0da9-4ecc-9ccf-23d3f93f2678 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:33.012739 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cffc137d-0da9-4ecc-9ccf-23d3f93f2678 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:33.013167 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cffc137d-0da9-4ecc-9ccf-23d3f93f2678 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:33.153543 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-cffc137d-0da9-4ecc-9ccf-23d3f93f2678 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:33.161848 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-cffc137d-0da9-4ecc-9ccf-23d3f93f2678 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154" status: 200 len: 1365 microversion: 2.1 time: 0.162910 Aug 26 16:03:33.175048 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 521/1022] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:32 2022] GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:03:33.713142 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-8c0cd719-2f7d-4738-b7d5-3e0aa8c6303d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:33.716883 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-8c0cd719-2f7d-4738-b7d5-3e0aa8c6303d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:33.721232 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8c0cd719-2f7d-4738-b7d5-3e0aa8c6303d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:33.721707 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8c0cd719-2f7d-4738-b7d5-3e0aa8c6303d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:33.722143 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8c0cd719-2f7d-4738-b7d5-3e0aa8c6303d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:33.722850 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8c0cd719-2f7d-4738-b7d5-3e0aa8c6303d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:33.723338 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8c0cd719-2f7d-4738-b7d5-3e0aa8c6303d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:33.723761 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8c0cd719-2f7d-4738-b7d5-3e0aa8c6303d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:33.867082 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-8c0cd719-2f7d-4738-b7d5-3e0aa8c6303d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:33.873624 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-8c0cd719-2f7d-4738-b7d5-3e0aa8c6303d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:33.875130 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-8c0cd719-2f7d-4738-b7d5-3e0aa8c6303d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:33.876277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-8c0cd719-2f7d-4738-b7d5-3e0aa8c6303d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1725 microversion: 2.20 time: 0.167246 Aug 26 16:03:33.876837 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 502/1023] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:33 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:03:34.057400 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a5999bf2-53dd-4038-8f16-e822b2d20b0d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2750ef1e-a0d0-4cac-9845-cf06bb61a86b"}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:03:34.059931 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a5999bf2-53dd-4038-8f16-e822b2d20b0d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:34.069061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a5999bf2-53dd-4038-8f16-e822b2d20b0d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:34.070242 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a5999bf2-53dd-4038-8f16-e822b2d20b0d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:34.070242 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a5999bf2-53dd-4038-8f16-e822b2d20b0d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:34.070710 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a5999bf2-53dd-4038-8f16-e822b2d20b0d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:34.071358 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a5999bf2-53dd-4038-8f16-e822b2d20b0d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:34.071783 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a5999bf2-53dd-4038-8f16-e822b2d20b0d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:34.184104 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-5c3c88b0-a6c4-425a-824a-66bb90b8136b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:34.184850 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-5c3c88b0-a6c4-425a-824a-66bb90b8136b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:34.190818 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5c3c88b0-a6c4-425a-824a-66bb90b8136b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:34.191411 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5c3c88b0-a6c4-425a-824a-66bb90b8136b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:34.191856 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5c3c88b0-a6c4-425a-824a-66bb90b8136b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:34.192558 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5c3c88b0-a6c4-425a-824a-66bb90b8136b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:34.193099 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5c3c88b0-a6c4-425a-824a-66bb90b8136b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:34.193861 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5c3c88b0-a6c4-425a-824a-66bb90b8136b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:34.215942 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=100 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:03:34.342824 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-5c3c88b0-a6c4-425a-824a-66bb90b8136b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:34.350393 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-5c3c88b0-a6c4-425a-824a-66bb90b8136b tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154" status: 200 len: 1365 microversion: 2.1 time: 0.171781 Aug 26 16:03:34.350968 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 503/1024] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:34 2022] GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:03:34.898233 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-e5618628-0918-4800-879d-ce38322471c2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:34.898905 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-e5618628-0918-4800-879d-ce38322471c2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:34.906306 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e5618628-0918-4800-879d-ce38322471c2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:34.906786 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e5618628-0918-4800-879d-ce38322471c2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:34.907282 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e5618628-0918-4800-879d-ce38322471c2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:34.907970 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e5618628-0918-4800-879d-ce38322471c2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:34.908418 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e5618628-0918-4800-879d-ce38322471c2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:34.908836 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e5618628-0918-4800-879d-ce38322471c2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:35.021907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a5999bf2-53dd-4038-8f16-e822b2d20b0d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "POST /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.968397 Aug 26 16:03:35.023162 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 522/1025] 10.222.0.94 () {60 vars in 1323 bytes} [Fri Aug 26 16:03:34 2022] POST /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff/os-volume_attachments => generated 194 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:03:35.052635 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e5618628-0918-4800-879d-ce38322471c2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:35.061193 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e5618628-0918-4800-879d-ce38322471c2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:35.062641 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e5618628-0918-4800-879d-ce38322471c2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:35.063836 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-e5618628-0918-4800-879d-ce38322471c2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1725 microversion: 2.20 time: 0.169743 Aug 26 16:03:35.064404 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 504/1026] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:34 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:03:35.373159 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-721ddaed-0191-4b46-8ac0-4248affb10ec tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:35.373159 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-721ddaed-0191-4b46-8ac0-4248affb10ec tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:35.378648 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-721ddaed-0191-4b46-8ac0-4248affb10ec tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:35.379158 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-721ddaed-0191-4b46-8ac0-4248affb10ec tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:35.379589 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-721ddaed-0191-4b46-8ac0-4248affb10ec tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:35.380285 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-721ddaed-0191-4b46-8ac0-4248affb10ec tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:35.380732 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-721ddaed-0191-4b46-8ac0-4248affb10ec tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:35.381363 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-721ddaed-0191-4b46-8ac0-4248affb10ec tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:35.520350 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-721ddaed-0191-4b46-8ac0-4248affb10ec tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:35.528802 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-721ddaed-0191-4b46-8ac0-4248affb10ec tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154" status: 200 len: 1365 microversion: 2.1 time: 0.161662 Aug 26 16:03:35.529359 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 523/1027] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:35 2022] GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:03:36.087897 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-9e69dfa0-9324-4d82-aaa9-631895b53828 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:36.088663 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-9e69dfa0-9324-4d82-aaa9-631895b53828 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:36.096528 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9e69dfa0-9324-4d82-aaa9-631895b53828 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:36.097572 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9e69dfa0-9324-4d82-aaa9-631895b53828 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:36.097572 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9e69dfa0-9324-4d82-aaa9-631895b53828 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:36.098182 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9e69dfa0-9324-4d82-aaa9-631895b53828 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:36.098644 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9e69dfa0-9324-4d82-aaa9-631895b53828 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:36.099214 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9e69dfa0-9324-4d82-aaa9-631895b53828 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:36.218990 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-8192f855-b56b-43b3-89b6-9836cdc59241 req-b2a84712-4bad-4e53-b73c-ebb811258d8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "579627a3-5e3e-40c0-be7a-c333ee8ee154", "name": "network-vif-plugged", "status": "completed", "tag": "fb610a76-d6cc-4bcd-be95-56a4a36620ad"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:03:36.225897 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell0:SELECT=2 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:03:36.231833 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell0:SELECT=12 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:03:36.232213 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-8192f855-b56b-43b3-89b6-9836cdc59241 req-b2a84712-4bad-4e53-b73c-ebb811258d8b service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:36.232696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-8192f855-b56b-43b3-89b6-9836cdc59241 req-b2a84712-4bad-4e53-b73c-ebb811258d8b service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:36.233125 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-8192f855-b56b-43b3-89b6-9836cdc59241 req-b2a84712-4bad-4e53-b73c-ebb811258d8b service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:36.237602 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-9e69dfa0-9324-4d82-aaa9-631895b53828 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:36.245406 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-8192f855-b56b-43b3-89b6-9836cdc59241 req-b2a84712-4bad-4e53-b73c-ebb811258d8b service nova] Creating event network-vif-plugged:fb610a76-d6cc-4bcd-be95-56a4a36620ad for instance 579627a3-5e3e-40c0-be7a-c333ee8ee154 on hv-cinder-85144 Aug 26 16:03:36.247121 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-9e69dfa0-9324-4d82-aaa9-631895b53828 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:36.249918 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-9e69dfa0-9324-4d82-aaa9-631895b53828 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:36.250320 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-8192f855-b56b-43b3-89b6-9836cdc59241 req-b2a84712-4bad-4e53-b73c-ebb811258d8b service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035011 Aug 26 16:03:36.251106 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 524/1028] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:03:36.251760 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-9e69dfa0-9324-4d82-aaa9-631895b53828 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1725 microversion: 2.20 time: 0.168493 Aug 26 16:03:36.252445 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 505/1029] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:36 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:03:36.549661 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-f6f5103b-a64f-4965-a4b1-1a23f12b7e60 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:36.550361 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-f6f5103b-a64f-4965-a4b1-1a23f12b7e60 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:36.559063 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f6f5103b-a64f-4965-a4b1-1a23f12b7e60 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:36.563811 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f6f5103b-a64f-4965-a4b1-1a23f12b7e60 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:36.563811 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f6f5103b-a64f-4965-a4b1-1a23f12b7e60 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:36.563811 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f6f5103b-a64f-4965-a4b1-1a23f12b7e60 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:36.563811 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f6f5103b-a64f-4965-a4b1-1a23f12b7e60 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:36.564463 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f6f5103b-a64f-4965-a4b1-1a23f12b7e60 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:36.781832 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-f6f5103b-a64f-4965-a4b1-1a23f12b7e60 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:36.789529 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-f6f5103b-a64f-4965-a4b1-1a23f12b7e60 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154" status: 200 len: 1365 microversion: 2.1 time: 0.244136 Aug 26 16:03:36.790103 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 525/1030] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:36 2022] GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154 => generated 1365 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:03:37.274527 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ef587cc7-12db-4cb0-bc81-1810c54264bc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:37.275437 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ef587cc7-12db-4cb0-bc81-1810c54264bc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:37.282067 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ef587cc7-12db-4cb0-bc81-1810c54264bc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:37.286235 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ef587cc7-12db-4cb0-bc81-1810c54264bc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:37.286235 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ef587cc7-12db-4cb0-bc81-1810c54264bc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:37.286235 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ef587cc7-12db-4cb0-bc81-1810c54264bc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:37.286235 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ef587cc7-12db-4cb0-bc81-1810c54264bc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:37.286639 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ef587cc7-12db-4cb0-bc81-1810c54264bc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:37.417192 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-ef587cc7-12db-4cb0-bc81-1810c54264bc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:37.425367 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-ef587cc7-12db-4cb0-bc81-1810c54264bc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:37.426862 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-ef587cc7-12db-4cb0-bc81-1810c54264bc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:37.428041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ef587cc7-12db-4cb0-bc81-1810c54264bc tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1725 microversion: 2.20 time: 0.157439 Aug 26 16:03:37.428599 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 506/1031] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:37 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:03:37.810847 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-7a467ec7-25b7-427e-a947-fec99efb6b71 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:37.811570 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-7a467ec7-25b7-427e-a947-fec99efb6b71 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:37.817988 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7a467ec7-25b7-427e-a947-fec99efb6b71 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:37.818668 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7a467ec7-25b7-427e-a947-fec99efb6b71 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:37.819151 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7a467ec7-25b7-427e-a947-fec99efb6b71 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:37.819847 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7a467ec7-25b7-427e-a947-fec99efb6b71 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:37.820360 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7a467ec7-25b7-427e-a947-fec99efb6b71 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:37.820790 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7a467ec7-25b7-427e-a947-fec99efb6b71 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:37.959350 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-7a467ec7-25b7-427e-a947-fec99efb6b71 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:37.967594 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-7a467ec7-25b7-427e-a947-fec99efb6b71 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154" status: 200 len: 1365 microversion: 2.1 time: 0.160815 Aug 26 16:03:37.968160 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 526/1032] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:37 2022] GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:03:38.452558 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-27f1b9cc-6f96-4933-bb21-dde2205a25b0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:38.453153 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-27f1b9cc-6f96-4933-bb21-dde2205a25b0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:38.459628 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-27f1b9cc-6f96-4933-bb21-dde2205a25b0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:38.460099 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-27f1b9cc-6f96-4933-bb21-dde2205a25b0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:38.460535 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-27f1b9cc-6f96-4933-bb21-dde2205a25b0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:38.461232 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-27f1b9cc-6f96-4933-bb21-dde2205a25b0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:38.461681 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-27f1b9cc-6f96-4933-bb21-dde2205a25b0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:38.462103 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-27f1b9cc-6f96-4933-bb21-dde2205a25b0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:38.600428 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-27f1b9cc-6f96-4933-bb21-dde2205a25b0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:38.609655 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-27f1b9cc-6f96-4933-bb21-dde2205a25b0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:38.611132 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-27f1b9cc-6f96-4933-bb21-dde2205a25b0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:38.612299 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-27f1b9cc-6f96-4933-bb21-dde2205a25b0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1725 microversion: 2.20 time: 0.163739 Aug 26 16:03:38.612869 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 507/1033] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:38 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:03:38.988625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-28ed83b6-bc5e-44b5-a00f-3b493afbe80c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:38.989228 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-28ed83b6-bc5e-44b5-a00f-3b493afbe80c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:38.996373 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-28ed83b6-bc5e-44b5-a00f-3b493afbe80c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:38.996848 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-28ed83b6-bc5e-44b5-a00f-3b493afbe80c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:38.997274 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-28ed83b6-bc5e-44b5-a00f-3b493afbe80c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:38.998583 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-28ed83b6-bc5e-44b5-a00f-3b493afbe80c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:38.999084 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-28ed83b6-bc5e-44b5-a00f-3b493afbe80c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:39.008593 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-28ed83b6-bc5e-44b5-a00f-3b493afbe80c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:39.138383 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-28ed83b6-bc5e-44b5-a00f-3b493afbe80c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:39.146188 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-28ed83b6-bc5e-44b5-a00f-3b493afbe80c tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154" status: 200 len: 1554 microversion: 2.1 time: 0.161525 Aug 26 16:03:39.146810 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 527/1034] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:03:38 2022] GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:03:39.171065 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ffb27735-2adb-45e4-838a-6354fe8ff812 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:39.171560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ffb27735-2adb-45e4-838a-6354fe8ff812 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:39.177488 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ffb27735-2adb-45e4-838a-6354fe8ff812 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:39.177968 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ffb27735-2adb-45e4-838a-6354fe8ff812 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:39.178402 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ffb27735-2adb-45e4-838a-6354fe8ff812 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:39.179144 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ffb27735-2adb-45e4-838a-6354fe8ff812 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:39.179596 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ffb27735-2adb-45e4-838a-6354fe8ff812 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:39.180027 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ffb27735-2adb-45e4-838a-6354fe8ff812 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:39.270069 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ffb27735-2adb-45e4-838a-6354fe8ff812 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102897 Aug 26 16:03:39.270953 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 508/1035] 10.222.0.94 () {58 vars in 1275 bytes} [Fri Aug 26 16:03:39 2022] GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:03:39.640257 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-47dfdc34-74fe-46cd-9fe1-c12b72734d1c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:39.641071 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-47dfdc34-74fe-46cd-9fe1-c12b72734d1c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:39.647369 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-47dfdc34-74fe-46cd-9fe1-c12b72734d1c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:39.648095 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-47dfdc34-74fe-46cd-9fe1-c12b72734d1c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:39.648715 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-47dfdc34-74fe-46cd-9fe1-c12b72734d1c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:39.649578 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-47dfdc34-74fe-46cd-9fe1-c12b72734d1c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:39.650383 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-47dfdc34-74fe-46cd-9fe1-c12b72734d1c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:39.650724 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-47dfdc34-74fe-46cd-9fe1-c12b72734d1c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:39.997720 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-47dfdc34-74fe-46cd-9fe1-c12b72734d1c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:40.005943 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-47dfdc34-74fe-46cd-9fe1-c12b72734d1c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:40.007441 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-47dfdc34-74fe-46cd-9fe1-c12b72734d1c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:40.009168 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-47dfdc34-74fe-46cd-9fe1-c12b72734d1c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1746 microversion: 2.20 time: 0.372221 Aug 26 16:03:40.009969 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 528/1036] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:39 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1746 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:03:40.710122 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-ffe8cac4-0dc1-489f-921c-80a8d9d995e9 req-93ab1a9a-b4fa-4b86-9a8c-ae7fac403676 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "579627a3-5e3e-40c0-be7a-c333ee8ee154", "tag": "fb610a76-d6cc-4bcd-be95-56a4a36620ad"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:03:40.720614 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-ffe8cac4-0dc1-489f-921c-80a8d9d995e9 req-93ab1a9a-b4fa-4b86-9a8c-ae7fac403676 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:40.721232 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-ffe8cac4-0dc1-489f-921c-80a8d9d995e9 req-93ab1a9a-b4fa-4b86-9a8c-ae7fac403676 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:40.721749 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-ffe8cac4-0dc1-489f-921c-80a8d9d995e9 req-93ab1a9a-b4fa-4b86-9a8c-ae7fac403676 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:40.734559 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-ffe8cac4-0dc1-489f-921c-80a8d9d995e9 req-93ab1a9a-b4fa-4b86-9a8c-ae7fac403676 service nova] Creating event network-changed:fb610a76-d6cc-4bcd-be95-56a4a36620ad for instance 579627a3-5e3e-40c0-be7a-c333ee8ee154 on hv-cinder-85144 Aug 26 16:03:40.740137 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-ffe8cac4-0dc1-489f-921c-80a8d9d995e9 req-93ab1a9a-b4fa-4b86-9a8c-ae7fac403676 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034276 Aug 26 16:03:40.741073 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 509/1037] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:03:41.032333 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-1cfabc64-a891-4e98-a4f0-273ae1a4fa3c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:41.032946 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-1cfabc64-a891-4e98-a4f0-273ae1a4fa3c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:41.040433 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1cfabc64-a891-4e98-a4f0-273ae1a4fa3c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:41.041202 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1cfabc64-a891-4e98-a4f0-273ae1a4fa3c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:41.041838 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1cfabc64-a891-4e98-a4f0-273ae1a4fa3c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:41.042791 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1cfabc64-a891-4e98-a4f0-273ae1a4fa3c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:41.043428 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1cfabc64-a891-4e98-a4f0-273ae1a4fa3c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:41.044034 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1cfabc64-a891-4e98-a4f0-273ae1a4fa3c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:41.303544 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-1cfabc64-a891-4e98-a4f0-273ae1a4fa3c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:41.312597 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-1cfabc64-a891-4e98-a4f0-273ae1a4fa3c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:41.314267 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-1cfabc64-a891-4e98-a4f0-273ae1a4fa3c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:41.315823 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-1cfabc64-a891-4e98-a4f0-273ae1a4fa3c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1746 microversion: 2.20 time: 0.287209 Aug 26 16:03:41.316497 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 529/1038] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:41 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1746 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:03:42.197338 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-d44229e5-d4fe-49a0-8c37-7b6386d1e521 req-4ad671cc-faa1-4482-a71e-e388fd77d728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fc0c879-6083-414b-b6ee-2046538f526f", "name": "network-vif-plugged", "status": "completed", "tag": "5921e1e6-5379-4181-b413-94122520d6d1"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:03:42.217895 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-d44229e5-d4fe-49a0-8c37-7b6386d1e521 req-4ad671cc-faa1-4482-a71e-e388fd77d728 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:42.218426 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-d44229e5-d4fe-49a0-8c37-7b6386d1e521 req-4ad671cc-faa1-4482-a71e-e388fd77d728 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:42.219054 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-d44229e5-d4fe-49a0-8c37-7b6386d1e521 req-4ad671cc-faa1-4482-a71e-e388fd77d728 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:42.232400 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-d44229e5-d4fe-49a0-8c37-7b6386d1e521 req-4ad671cc-faa1-4482-a71e-e388fd77d728 service nova] Creating event network-vif-plugged:5921e1e6-5379-4181-b413-94122520d6d1 for instance 3fc0c879-6083-414b-b6ee-2046538f526f on hv-cinder-85144 Aug 26 16:03:42.244750 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-d44229e5-d4fe-49a0-8c37-7b6386d1e521 req-4ad671cc-faa1-4482-a71e-e388fd77d728 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054753 Aug 26 16:03:42.246288 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 510/1039] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:03:42.342419 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-286a361c-c799-4a05-9167-9cb852ea585c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:42.343074 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-286a361c-c799-4a05-9167-9cb852ea585c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:42.360382 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-286a361c-c799-4a05-9167-9cb852ea585c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:42.361589 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-286a361c-c799-4a05-9167-9cb852ea585c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:42.362296 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-286a361c-c799-4a05-9167-9cb852ea585c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:42.377693 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-286a361c-c799-4a05-9167-9cb852ea585c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:42.378595 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-286a361c-c799-4a05-9167-9cb852ea585c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:42.382195 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-286a361c-c799-4a05-9167-9cb852ea585c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:42.740957 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-286a361c-c799-4a05-9167-9cb852ea585c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:42.750495 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-286a361c-c799-4a05-9167-9cb852ea585c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:42.755560 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-286a361c-c799-4a05-9167-9cb852ea585c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:42.760664 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-286a361c-c799-4a05-9167-9cb852ea585c tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1741 microversion: 2.20 time: 0.424521 Aug 26 16:03:42.763466 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 530/1040] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:42 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1741 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:03:43.787842 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-8796c1c9-d5f9-43e7-a85a-8892bf60c6b1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:43.788720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-8796c1c9-d5f9-43e7-a85a-8892bf60c6b1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:43.791159 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:03:43.797804 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8796c1c9-d5f9-43e7-a85a-8892bf60c6b1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:43.798373 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8796c1c9-d5f9-43e7-a85a-8892bf60c6b1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:43.798977 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8796c1c9-d5f9-43e7-a85a-8892bf60c6b1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:43.799615 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8796c1c9-d5f9-43e7-a85a-8892bf60c6b1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:43.800101 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8796c1c9-d5f9-43e7-a85a-8892bf60c6b1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:43.800478 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8796c1c9-d5f9-43e7-a85a-8892bf60c6b1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:43.828031 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-40e76e40-7856-433c-acc9-5c40691c006d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:43.830338 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-40e76e40-7856-433c-acc9-5c40691c006d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:43.838990 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-40e76e40-7856-433c-acc9-5c40691c006d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:43.846842 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-40e76e40-7856-433c-acc9-5c40691c006d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:43.846842 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-40e76e40-7856-433c-acc9-5c40691c006d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:43.846842 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-40e76e40-7856-433c-acc9-5c40691c006d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:43.846842 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-40e76e40-7856-433c-acc9-5c40691c006d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:43.847531 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-40e76e40-7856-433c-acc9-5c40691c006d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:43.894691 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-40e76e40-7856-433c-acc9-5c40691c006d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072748 Aug 26 16:03:43.897353 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 531/1041] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:03:43 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:03:43.913470 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-1d061a73-a918-4e26-b5dd-fdca34534c66 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:43.914052 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-1d061a73-a918-4e26-b5dd-fdca34534c66 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:43.931602 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1d061a73-a918-4e26-b5dd-fdca34534c66 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:43.932876 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1d061a73-a918-4e26-b5dd-fdca34534c66 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:43.933568 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1d061a73-a918-4e26-b5dd-fdca34534c66 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:43.934555 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1d061a73-a918-4e26-b5dd-fdca34534c66 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:43.935318 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1d061a73-a918-4e26-b5dd-fdca34534c66 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:43.935935 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1d061a73-a918-4e26-b5dd-fdca34534c66 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:43.983459 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-1d061a73-a918-4e26-b5dd-fdca34534c66 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff/os-volume_attachments/2750ef1e-a0d0-4cac-9845-cf06bb61a86b" status: 200 len: 194 microversion: 2.1 time: 0.078264 Aug 26 16:03:43.984489 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 532/1042] 10.222.0.94 () {58 vars in 1413 bytes} [Fri Aug 26 16:03:43 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff/os-volume_attachments/2750ef1e-a0d0-4cac-9845-cf06bb61a86b => generated 194 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:03:44.014859 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-8796c1c9-d5f9-43e7-a85a-8892bf60c6b1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:44.023304 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-8796c1c9-d5f9-43e7-a85a-8892bf60c6b1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:44.025503 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-8796c1c9-d5f9-43e7-a85a-8892bf60c6b1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:44.027203 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-8796c1c9-d5f9-43e7-a85a-8892bf60c6b1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1741 microversion: 2.20 time: 0.244617 Aug 26 16:03:44.027957 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 511/1043] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:43 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1741 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:03:45.055577 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-21dd7def-fd1e-4053-8901-7052c4ef73c4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:45.063896 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-21dd7def-fd1e-4053-8901-7052c4ef73c4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:45.068506 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-21dd7def-fd1e-4053-8901-7052c4ef73c4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:45.069185 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-21dd7def-fd1e-4053-8901-7052c4ef73c4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:45.073360 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-21dd7def-fd1e-4053-8901-7052c4ef73c4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:45.074490 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-21dd7def-fd1e-4053-8901-7052c4ef73c4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:45.075170 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-21dd7def-fd1e-4053-8901-7052c4ef73c4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:45.075949 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-21dd7def-fd1e-4053-8901-7052c4ef73c4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:45.264385 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-21dd7def-fd1e-4053-8901-7052c4ef73c4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:45.272384 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-21dd7def-fd1e-4053-8901-7052c4ef73c4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:45.273958 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-21dd7def-fd1e-4053-8901-7052c4ef73c4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:45.275251 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-21dd7def-fd1e-4053-8901-7052c4ef73c4 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1741 microversion: 2.20 time: 0.223837 Aug 26 16:03:45.275811 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 533/1044] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:45 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1741 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:03:46.174481 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-52fb2c62-5c7e-4c1e-a97a-2e4937ffa354 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "920baeee-14d4-4a0d-9b93-b7d0758371d5"}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:03:46.177107 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-52fb2c62-5c7e-4c1e-a97a-2e4937ffa354 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:46.185851 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-52fb2c62-5c7e-4c1e-a97a-2e4937ffa354 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:46.186420 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-52fb2c62-5c7e-4c1e-a97a-2e4937ffa354 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:46.186947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-52fb2c62-5c7e-4c1e-a97a-2e4937ffa354 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:46.187657 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-52fb2c62-5c7e-4c1e-a97a-2e4937ffa354 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:46.188124 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-52fb2c62-5c7e-4c1e-a97a-2e4937ffa354 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:46.188545 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-52fb2c62-5c7e-4c1e-a97a-2e4937ffa354 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:46.297816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-ddc81e37-eae2-4876-b179-fde6763b4799 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:46.299194 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-ddc81e37-eae2-4876-b179-fde6763b4799 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:46.306097 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ddc81e37-eae2-4876-b179-fde6763b4799 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:46.306816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ddc81e37-eae2-4876-b179-fde6763b4799 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:46.307442 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ddc81e37-eae2-4876-b179-fde6763b4799 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:46.309035 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ddc81e37-eae2-4876-b179-fde6763b4799 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:46.309829 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ddc81e37-eae2-4876-b179-fde6763b4799 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:46.310406 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ddc81e37-eae2-4876-b179-fde6763b4799 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:46.491258 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-ddc81e37-eae2-4876-b179-fde6763b4799 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:46.501398 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-ddc81e37-eae2-4876-b179-fde6763b4799 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:46.503170 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-ddc81e37-eae2-4876-b179-fde6763b4799 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:46.504746 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-ddc81e37-eae2-4876-b179-fde6763b4799 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1741 microversion: 2.20 time: 0.210790 Aug 26 16:03:46.510652 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 534/1045] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:46 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1741 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:03:47.475924 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-52fb2c62-5c7e-4c1e-a97a-2e4937ffa354 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "POST /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.306381 Aug 26 16:03:47.476775 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 512/1046] 10.222.0.94 () {60 vars in 1323 bytes} [Fri Aug 26 16:03:46 2022] POST /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff/os-volume_attachments => generated 194 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:03:47.533608 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-9424d229-0cd8-44f6-8157-6f28ff2bea2f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:47.535292 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-9424d229-0cd8-44f6-8157-6f28ff2bea2f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:47.545402 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9424d229-0cd8-44f6-8157-6f28ff2bea2f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:47.545932 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9424d229-0cd8-44f6-8157-6f28ff2bea2f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:47.546413 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9424d229-0cd8-44f6-8157-6f28ff2bea2f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:47.547346 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9424d229-0cd8-44f6-8157-6f28ff2bea2f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:47.547801 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9424d229-0cd8-44f6-8157-6f28ff2bea2f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:47.548218 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9424d229-0cd8-44f6-8157-6f28ff2bea2f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:47.718216 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-9424d229-0cd8-44f6-8157-6f28ff2bea2f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:47.730344 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-9424d229-0cd8-44f6-8157-6f28ff2bea2f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:47.731184 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-9424d229-0cd8-44f6-8157-6f28ff2bea2f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:47.732125 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-9424d229-0cd8-44f6-8157-6f28ff2bea2f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1741 microversion: 2.20 time: 0.202684 Aug 26 16:03:47.733172 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 535/1047] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:47 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1741 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:03:48.757475 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-05af65ff-8604-4e4f-a581-6eae63009d18 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:48.758206 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-05af65ff-8604-4e4f-a581-6eae63009d18 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:48.765222 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-05af65ff-8604-4e4f-a581-6eae63009d18 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:48.765693 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-05af65ff-8604-4e4f-a581-6eae63009d18 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:48.766122 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-05af65ff-8604-4e4f-a581-6eae63009d18 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:48.766806 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-05af65ff-8604-4e4f-a581-6eae63009d18 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:48.767278 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-05af65ff-8604-4e4f-a581-6eae63009d18 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:48.767702 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-05af65ff-8604-4e4f-a581-6eae63009d18 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:48.905857 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-05af65ff-8604-4e4f-a581-6eae63009d18 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:48.915258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-05af65ff-8604-4e4f-a581-6eae63009d18 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:48.917250 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-05af65ff-8604-4e4f-a581-6eae63009d18 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:48.918603 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-05af65ff-8604-4e4f-a581-6eae63009d18 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1741 microversion: 2.20 time: 0.165972 Aug 26 16:03:48.919303 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 513/1048] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:48 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1741 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:03:49.945398 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-c5306449-1317-4ba6-b667-de688ad78b43 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:49.946005 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-c5306449-1317-4ba6-b667-de688ad78b43 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:49.952795 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c5306449-1317-4ba6-b667-de688ad78b43 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:49.953281 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c5306449-1317-4ba6-b667-de688ad78b43 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:49.953714 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c5306449-1317-4ba6-b667-de688ad78b43 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:49.954405 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c5306449-1317-4ba6-b667-de688ad78b43 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:49.954851 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c5306449-1317-4ba6-b667-de688ad78b43 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:49.955297 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c5306449-1317-4ba6-b667-de688ad78b43 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:50.118688 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-c5306449-1317-4ba6-b667-de688ad78b43 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:50.122362 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:03:50.128002 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-c5306449-1317-4ba6-b667-de688ad78b43 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:50.129420 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-c5306449-1317-4ba6-b667-de688ad78b43 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:50.130619 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-c5306449-1317-4ba6-b667-de688ad78b43 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1741 microversion: 2.20 time: 0.190116 Aug 26 16:03:50.140212 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 536/1049] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:49 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1741 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:03:51.158754 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-23787b6e-b865-4139-abb4-df7ac13422c9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:51.164405 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-23787b6e-b865-4139-abb4-df7ac13422c9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:51.169800 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-23787b6e-b865-4139-abb4-df7ac13422c9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:51.170317 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-23787b6e-b865-4139-abb4-df7ac13422c9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:51.170765 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-23787b6e-b865-4139-abb4-df7ac13422c9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:51.172585 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-23787b6e-b865-4139-abb4-df7ac13422c9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:51.173831 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-23787b6e-b865-4139-abb4-df7ac13422c9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:51.175420 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-23787b6e-b865-4139-abb4-df7ac13422c9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:51.352976 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-23787b6e-b865-4139-abb4-df7ac13422c9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:51.363590 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-23787b6e-b865-4139-abb4-df7ac13422c9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:51.365176 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-23787b6e-b865-4139-abb4-df7ac13422c9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:51.366365 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-23787b6e-b865-4139-abb4-df7ac13422c9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1741 microversion: 2.20 time: 0.212492 Aug 26 16:03:51.380633 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 514/1050] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:51 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1741 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:03:52.391091 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-347dbd84-3df2-4631-b906-e13728b6e6fb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:52.391713 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-347dbd84-3df2-4631-b906-e13728b6e6fb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:52.394405 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:03:52.399493 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-347dbd84-3df2-4631-b906-e13728b6e6fb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:52.399997 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-347dbd84-3df2-4631-b906-e13728b6e6fb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:52.400431 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-347dbd84-3df2-4631-b906-e13728b6e6fb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:52.401119 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-347dbd84-3df2-4631-b906-e13728b6e6fb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:52.401571 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-347dbd84-3df2-4631-b906-e13728b6e6fb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:52.402118 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-347dbd84-3df2-4631-b906-e13728b6e6fb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:52.541314 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-347dbd84-3df2-4631-b906-e13728b6e6fb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:52.549728 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-347dbd84-3df2-4631-b906-e13728b6e6fb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:52.551262 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-347dbd84-3df2-4631-b906-e13728b6e6fb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:52.552413 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-347dbd84-3df2-4631-b906-e13728b6e6fb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1741 microversion: 2.20 time: 0.166193 Aug 26 16:03:52.552971 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 537/1051] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:52 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:03:53.578888 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-cf4a3ab8-afcc-4da5-96a0-5743d327912f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:53.579630 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-cf4a3ab8-afcc-4da5-96a0-5743d327912f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:53.586751 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cf4a3ab8-afcc-4da5-96a0-5743d327912f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:53.596786 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cf4a3ab8-afcc-4da5-96a0-5743d327912f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:53.596786 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cf4a3ab8-afcc-4da5-96a0-5743d327912f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:53.596786 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cf4a3ab8-afcc-4da5-96a0-5743d327912f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:53.596786 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cf4a3ab8-afcc-4da5-96a0-5743d327912f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:53.597222 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cf4a3ab8-afcc-4da5-96a0-5743d327912f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:53.724407 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-cf4a3ab8-afcc-4da5-96a0-5743d327912f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:53.746368 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-cf4a3ab8-afcc-4da5-96a0-5743d327912f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:53.746368 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-cf4a3ab8-afcc-4da5-96a0-5743d327912f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:53.748081 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-cf4a3ab8-afcc-4da5-96a0-5743d327912f tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1741 microversion: 2.20 time: 0.174892 Aug 26 16:03:53.762395 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 515/1052] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:53 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:03:54.770373 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a7370869-c2fd-489c-839b-6dd243d9e479 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:54.771009 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a7370869-c2fd-489c-839b-6dd243d9e479 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:54.778934 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a7370869-c2fd-489c-839b-6dd243d9e479 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:54.779433 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a7370869-c2fd-489c-839b-6dd243d9e479 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:54.779934 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a7370869-c2fd-489c-839b-6dd243d9e479 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:54.780594 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a7370869-c2fd-489c-839b-6dd243d9e479 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:54.781047 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a7370869-c2fd-489c-839b-6dd243d9e479 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:54.781475 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a7370869-c2fd-489c-839b-6dd243d9e479 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:54.911831 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a7370869-c2fd-489c-839b-6dd243d9e479 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:54.920302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a7370869-c2fd-489c-839b-6dd243d9e479 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:54.921720 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a7370869-c2fd-489c-839b-6dd243d9e479 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:54.922968 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a7370869-c2fd-489c-839b-6dd243d9e479 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1723 microversion: 2.20 time: 0.157233 Aug 26 16:03:54.923518 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 538/1053] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:54 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:03:55.946082 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-eaf73063-e7e7-4d39-bf00-8bb42858ef64 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:55.946695 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-eaf73063-e7e7-4d39-bf00-8bb42858ef64 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:55.953889 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-eaf73063-e7e7-4d39-bf00-8bb42858ef64 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:55.954443 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-eaf73063-e7e7-4d39-bf00-8bb42858ef64 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:55.955132 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-eaf73063-e7e7-4d39-bf00-8bb42858ef64 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:55.955833 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-eaf73063-e7e7-4d39-bf00-8bb42858ef64 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:55.956693 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-eaf73063-e7e7-4d39-bf00-8bb42858ef64 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:55.956693 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-eaf73063-e7e7-4d39-bf00-8bb42858ef64 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:56.106867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-eaf73063-e7e7-4d39-bf00-8bb42858ef64 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:56.116665 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-eaf73063-e7e7-4d39-bf00-8bb42858ef64 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:56.118409 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-eaf73063-e7e7-4d39-bf00-8bb42858ef64 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:56.119755 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-eaf73063-e7e7-4d39-bf00-8bb42858ef64 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1723 microversion: 2.20 time: 0.177917 Aug 26 16:03:56.121087 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 516/1054] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:55 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:03:56.780073 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-4b0636fc-e1a0-4cb2-8837-d4eab59b62ce tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:56.782614 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-4b0636fc-e1a0-4cb2-8837-d4eab59b62ce tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:56.789343 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4b0636fc-e1a0-4cb2-8837-d4eab59b62ce tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:56.793398 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4b0636fc-e1a0-4cb2-8837-d4eab59b62ce tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:56.793398 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4b0636fc-e1a0-4cb2-8837-d4eab59b62ce tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:56.793398 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4b0636fc-e1a0-4cb2-8837-d4eab59b62ce tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:56.793398 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4b0636fc-e1a0-4cb2-8837-d4eab59b62ce tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:56.793814 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4b0636fc-e1a0-4cb2-8837-d4eab59b62ce tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:56.823356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-4b0636fc-e1a0-4cb2-8837-d4eab59b62ce tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048071 Aug 26 16:03:56.824162 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 539/1055] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:03:56 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:03:56.968769 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-9d6ce44e-2233-4f79-a7f6-89784218aeea tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:56.970687 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-9d6ce44e-2233-4f79-a7f6-89784218aeea tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:56.975559 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9d6ce44e-2233-4f79-a7f6-89784218aeea tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:56.976072 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9d6ce44e-2233-4f79-a7f6-89784218aeea tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:56.976411 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9d6ce44e-2233-4f79-a7f6-89784218aeea tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:56.977308 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9d6ce44e-2233-4f79-a7f6-89784218aeea tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:56.977762 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9d6ce44e-2233-4f79-a7f6-89784218aeea tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:56.978192 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9d6ce44e-2233-4f79-a7f6-89784218aeea tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:57.008433 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-9d6ce44e-2233-4f79-a7f6-89784218aeea tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff/os-volume_attachments/2750ef1e-a0d0-4cac-9845-cf06bb61a86b" status: 200 len: 194 microversion: 2.1 time: 0.044220 Aug 26 16:03:57.009016 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 517/1056] 10.222.0.94 () {58 vars in 1413 bytes} [Fri Aug 26 16:03:56 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff/os-volume_attachments/2750ef1e-a0d0-4cac-9845-cf06bb61a86b => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:03:57.019296 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-bf50b58a-e480-4e82-9d2f-d5ce137ed350 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:57.019970 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-bf50b58a-e480-4e82-9d2f-d5ce137ed350 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:57.025610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bf50b58a-e480-4e82-9d2f-d5ce137ed350 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:57.026079 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bf50b58a-e480-4e82-9d2f-d5ce137ed350 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:57.026507 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bf50b58a-e480-4e82-9d2f-d5ce137ed350 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:57.027245 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bf50b58a-e480-4e82-9d2f-d5ce137ed350 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:57.027692 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bf50b58a-e480-4e82-9d2f-d5ce137ed350 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:57.028110 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bf50b58a-e480-4e82-9d2f-d5ce137ed350 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:57.110593 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-bf50b58a-e480-4e82-9d2f-d5ce137ed350 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lazy-loading 'services' on Instance uuid 4c945896-ccdd-42e4-a22c-b21e453512ff {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:03:57.145075 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f104477d-5334-4e63-a751-ea9c3bf7af55 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:57.146400 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-f104477d-5334-4e63-a751-ea9c3bf7af55 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:57.154494 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f104477d-5334-4e63-a751-ea9c3bf7af55 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:57.155297 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f104477d-5334-4e63-a751-ea9c3bf7af55 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:57.157406 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f104477d-5334-4e63-a751-ea9c3bf7af55 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:57.157406 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f104477d-5334-4e63-a751-ea9c3bf7af55 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:57.157406 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f104477d-5334-4e63-a751-ea9c3bf7af55 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:57.158451 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f104477d-5334-4e63-a751-ea9c3bf7af55 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:57.292315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-f104477d-5334-4e63-a751-ea9c3bf7af55 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:57.301219 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-f104477d-5334-4e63-a751-ea9c3bf7af55 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:57.305052 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-f104477d-5334-4e63-a751-ea9c3bf7af55 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:57.305052 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-f104477d-5334-4e63-a751-ea9c3bf7af55 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1723 microversion: 2.20 time: 0.163686 Aug 26 16:03:57.305052 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 518/1057] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:57 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:03:57.373722 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-bf50b58a-e480-4e82-9d2f-d5ce137ed350 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "DELETE /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff/os-volume_attachments/2750ef1e-a0d0-4cac-9845-cf06bb61a86b" status: 202 len: 0 microversion: 2.1 time: 0.357997 Aug 26 16:03:57.377129 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 540/1058] 10.222.0.94 () {58 vars in 1416 bytes} [Fri Aug 26 16:03:57 2022] DELETE /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff/os-volume_attachments/2750ef1e-a0d0-4cac-9845-cf06bb61a86b => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 16:03:58.139031 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-4b513054-3f9a-4a55-9ff1-afa10ab0db28 req-974ce7cb-9349-4f66-a4f6-e3cad5ebd87c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fc0c879-6083-414b-b6ee-2046538f526f", "name": "network-vif-unplugged", "status": "completed", "tag": "5921e1e6-5379-4181-b413-94122520d6d1"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:03:58.151270 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-4b513054-3f9a-4a55-9ff1-afa10ab0db28 req-974ce7cb-9349-4f66-a4f6-e3cad5ebd87c service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:58.151756 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-4b513054-3f9a-4a55-9ff1-afa10ab0db28 req-974ce7cb-9349-4f66-a4f6-e3cad5ebd87c service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:58.152193 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-4b513054-3f9a-4a55-9ff1-afa10ab0db28 req-974ce7cb-9349-4f66-a4f6-e3cad5ebd87c service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:58.165680 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-4b513054-3f9a-4a55-9ff1-afa10ab0db28 req-974ce7cb-9349-4f66-a4f6-e3cad5ebd87c service nova] Creating event network-vif-unplugged:5921e1e6-5379-4181-b413-94122520d6d1 for instance 3fc0c879-6083-414b-b6ee-2046538f526f on hv-cinder-85144 Aug 26 16:03:58.170839 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-4b513054-3f9a-4a55-9ff1-afa10ab0db28 req-974ce7cb-9349-4f66-a4f6-e3cad5ebd87c service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036195 Aug 26 16:03:58.176403 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 519/1059] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:03:58.329253 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-05c6c63e-505b-4d23-b082-b79171084bb7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:58.330042 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-05c6c63e-505b-4d23-b082-b79171084bb7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:58.336897 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-05c6c63e-505b-4d23-b082-b79171084bb7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:58.337380 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-05c6c63e-505b-4d23-b082-b79171084bb7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:58.337811 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-05c6c63e-505b-4d23-b082-b79171084bb7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:58.338495 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-05c6c63e-505b-4d23-b082-b79171084bb7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:58.338970 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-05c6c63e-505b-4d23-b082-b79171084bb7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:58.339510 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-05c6c63e-505b-4d23-b082-b79171084bb7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:58.478027 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-05c6c63e-505b-4d23-b082-b79171084bb7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:58.487121 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-05c6c63e-505b-4d23-b082-b79171084bb7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:58.488553 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-05c6c63e-505b-4d23-b082-b79171084bb7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:58.489709 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-05c6c63e-505b-4d23-b082-b79171084bb7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1723 microversion: 2.20 time: 0.165848 Aug 26 16:03:58.490279 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 541/1060] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:58 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:03:59.514115 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-e3790fcb-4206-4fb7-8550-621883895023 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:03:59.514821 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-e3790fcb-4206-4fb7-8550-621883895023 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:59.520981 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e3790fcb-4206-4fb7-8550-621883895023 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:59.521512 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e3790fcb-4206-4fb7-8550-621883895023 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:59.521986 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e3790fcb-4206-4fb7-8550-621883895023 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:59.522733 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e3790fcb-4206-4fb7-8550-621883895023 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:59.523237 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e3790fcb-4206-4fb7-8550-621883895023 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:59.523667 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e3790fcb-4206-4fb7-8550-621883895023 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:59.664819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e3790fcb-4206-4fb7-8550-621883895023 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:59.672390 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e3790fcb-4206-4fb7-8550-621883895023 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:59.673813 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e3790fcb-4206-4fb7-8550-621883895023 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:03:59.675231 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-e3790fcb-4206-4fb7-8550-621883895023 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1726 microversion: 2.20 time: 0.165991 Aug 26 16:03:59.675780 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 520/1061] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:03:59 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:03:59.699771 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-67c3dfb3-ae0a-43d4-940d-2a473327a2a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a996f54b-b322-4df3-9d96-eaa0aa3789eb"}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:03:59.702473 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-67c3dfb3-ae0a-43d4-940d-2a473327a2a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:03:59.710178 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-67c3dfb3-ae0a-43d4-940d-2a473327a2a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:59.710669 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-67c3dfb3-ae0a-43d4-940d-2a473327a2a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:59.711130 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-67c3dfb3-ae0a-43d4-940d-2a473327a2a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:03:59.711830 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-67c3dfb3-ae0a-43d4-940d-2a473327a2a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:03:59.712277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-67c3dfb3-ae0a-43d4-940d-2a473327a2a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:03:59.712697 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-67c3dfb3-ae0a-43d4-940d-2a473327a2a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:00.620383 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-a3cc93ed-6e8a-4f96-a4db-44f8448b5c01 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:00.621359 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-a3cc93ed-6e8a-4f96-a4db-44f8448b5c01 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:00.627293 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a3cc93ed-6e8a-4f96-a4db-44f8448b5c01 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:00.627757 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a3cc93ed-6e8a-4f96-a4db-44f8448b5c01 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:00.628193 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a3cc93ed-6e8a-4f96-a4db-44f8448b5c01 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:00.628886 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a3cc93ed-6e8a-4f96-a4db-44f8448b5c01 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:00.629363 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a3cc93ed-6e8a-4f96-a4db-44f8448b5c01 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:00.629764 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a3cc93ed-6e8a-4f96-a4db-44f8448b5c01 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:00.632246 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:04:00.660325 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-a3cc93ed-6e8a-4f96-a4db-44f8448b5c01 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff/os-volume_attachments/920baeee-14d4-4a0d-9b93-b7d0758371d5" status: 200 len: 194 microversion: 2.1 time: 0.044021 Aug 26 16:04:00.660915 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 521/1062] 10.222.0.94 () {58 vars in 1413 bytes} [Fri Aug 26 16:04:00 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff/os-volume_attachments/920baeee-14d4-4a0d-9b93-b7d0758371d5 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:04:00.671814 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-91972652-37f1-4a6b-8804-ec37105e8517 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:00.672296 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-91972652-37f1-4a6b-8804-ec37105e8517 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:00.677994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-91972652-37f1-4a6b-8804-ec37105e8517 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:00.678469 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-91972652-37f1-4a6b-8804-ec37105e8517 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:00.678905 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-91972652-37f1-4a6b-8804-ec37105e8517 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:00.679646 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-91972652-37f1-4a6b-8804-ec37105e8517 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:00.680095 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-91972652-37f1-4a6b-8804-ec37105e8517 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:00.680513 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-91972652-37f1-4a6b-8804-ec37105e8517 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:00.765015 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.objects.instance [None req-91972652-37f1-4a6b-8804-ec37105e8517 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lazy-loading 'services' on Instance uuid 4c945896-ccdd-42e4-a22c-b21e453512ff {{(pid=128304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:04:01.027462 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-91972652-37f1-4a6b-8804-ec37105e8517 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "DELETE /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff/os-volume_attachments/920baeee-14d4-4a0d-9b93-b7d0758371d5" status: 202 len: 0 microversion: 2.1 time: 0.359502 Aug 26 16:04:01.027968 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 522/1063] 10.222.0.94 () {58 vars in 1416 bytes} [Fri Aug 26 16:04:00 2022] DELETE /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff/os-volume_attachments/920baeee-14d4-4a0d-9b93-b7d0758371d5 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 16:04:01.258490 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-67c3dfb3-ae0a-43d4-940d-2a473327a2a3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "POST /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.563487 Aug 26 16:04:01.263269 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 542/1064] 10.222.0.94 () {62 vars in 1364 bytes} [Fri Aug 26 16:03:59 2022] POST /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f/os-volume_attachments => generated 188 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 16:04:01.382582 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-15ca752e-8ec1-4e66-aa58-35ec592306b6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:01.383192 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-15ca752e-8ec1-4e66-aa58-35ec592306b6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:01.389723 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-15ca752e-8ec1-4e66-aa58-35ec592306b6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:01.390207 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-15ca752e-8ec1-4e66-aa58-35ec592306b6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:01.390644 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-15ca752e-8ec1-4e66-aa58-35ec592306b6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:01.391375 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-15ca752e-8ec1-4e66-aa58-35ec592306b6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:01.391826 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-15ca752e-8ec1-4e66-aa58-35ec592306b6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:01.392252 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-15ca752e-8ec1-4e66-aa58-35ec592306b6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:02.130494 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-15ca752e-8ec1-4e66-aa58-35ec592306b6 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "DELETE /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f/os-volume_attachments/a996f54b-b322-4df3-9d96-eaa0aa3789eb" status: 202 len: 0 microversion: 2.20 time: 0.752033 Aug 26 16:04:02.131204 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 523/1065] 10.222.0.94 () {60 vars in 1457 bytes} [Fri Aug 26 16:04:01 2022] DELETE /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f/os-volume_attachments/a996f54b-b322-4df3-9d96-eaa0aa3789eb => generated 0 bytes in 754 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 16:04:02.209406 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-cdf6da2f-6f5b-4757-87d2-3df8bb9d0904 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:04:02.210030 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-cdf6da2f-6f5b-4757-87d2-3df8bb9d0904 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:02.218306 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cdf6da2f-6f5b-4757-87d2-3df8bb9d0904 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:02.218793 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cdf6da2f-6f5b-4757-87d2-3df8bb9d0904 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:02.219255 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cdf6da2f-6f5b-4757-87d2-3df8bb9d0904 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:02.219996 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cdf6da2f-6f5b-4757-87d2-3df8bb9d0904 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:02.220444 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cdf6da2f-6f5b-4757-87d2-3df8bb9d0904 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:02.220904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cdf6da2f-6f5b-4757-87d2-3df8bb9d0904 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:02.253651 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-cdf6da2f-6f5b-4757-87d2-3df8bb9d0904 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128305) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 26 16:04:02.550496 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-cdf6da2f-6f5b-4757-87d2-3df8bb9d0904 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "POST /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f/action" status: 202 len: 0 microversion: 2.20 time: 0.345024 Aug 26 16:04:02.551196 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 543/1066] 10.222.0.94 () {62 vars in 1319 bytes} [Fri Aug 26 16:04:02 2022] POST /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 16:04:02.560171 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-a99ab3d0-912c-467d-b6f0-db97df659669 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:02.560931 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-a99ab3d0-912c-467d-b6f0-db97df659669 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:02.568416 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a99ab3d0-912c-467d-b6f0-db97df659669 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:02.573066 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a99ab3d0-912c-467d-b6f0-db97df659669 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:02.573066 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a99ab3d0-912c-467d-b6f0-db97df659669 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:02.573066 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a99ab3d0-912c-467d-b6f0-db97df659669 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:02.573066 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a99ab3d0-912c-467d-b6f0-db97df659669 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:02.573435 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a99ab3d0-912c-467d-b6f0-db97df659669 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:02.705788 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-a99ab3d0-912c-467d-b6f0-db97df659669 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:02.714150 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-a99ab3d0-912c-467d-b6f0-db97df659669 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:02.716135 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-a99ab3d0-912c-467d-b6f0-db97df659669 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:02.717470 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-a99ab3d0-912c-467d-b6f0-db97df659669 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1674 microversion: 2.20 time: 0.161898 Aug 26 16:04:02.718026 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 524/1067] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:04:02 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:04:03.384307 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-c22d2d62-7eb0-4896-8669-4a9da716a1af tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:03.386574 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-c22d2d62-7eb0-4896-8669-4a9da716a1af tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:03.393291 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c22d2d62-7eb0-4896-8669-4a9da716a1af tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:03.393842 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c22d2d62-7eb0-4896-8669-4a9da716a1af tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:03.394284 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c22d2d62-7eb0-4896-8669-4a9da716a1af tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:03.395033 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c22d2d62-7eb0-4896-8669-4a9da716a1af tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:03.395492 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c22d2d62-7eb0-4896-8669-4a9da716a1af tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:03.395916 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c22d2d62-7eb0-4896-8669-4a9da716a1af tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:03.428523 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-c22d2d62-7eb0-4896-8669-4a9da716a1af tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048561 Aug 26 16:04:03.429292 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 544/1068] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:04:03 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 16:04:03.548206 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7db3fc9f-e8cd-42c4-a5b3-357cd5ded5eb tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:03.550724 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-7db3fc9f-e8cd-42c4-a5b3-357cd5ded5eb tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:03.556610 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7db3fc9f-e8cd-42c4-a5b3-357cd5ded5eb tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:03.557085 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7db3fc9f-e8cd-42c4-a5b3-357cd5ded5eb tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:03.557521 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7db3fc9f-e8cd-42c4-a5b3-357cd5ded5eb tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:03.558204 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7db3fc9f-e8cd-42c4-a5b3-357cd5ded5eb tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:03.558653 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7db3fc9f-e8cd-42c4-a5b3-357cd5ded5eb tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:03.559197 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7db3fc9f-e8cd-42c4-a5b3-357cd5ded5eb tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:03.589124 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-7db3fc9f-e8cd-42c4-a5b3-357cd5ded5eb tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045661 Aug 26 16:04:03.589610 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 525/1069] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:04:03 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 26 16:04:03.652748 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-fb6210d0-153e-4297-992e-1eeabb2d7820 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:03.653950 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-fb6210d0-153e-4297-992e-1eeabb2d7820 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:03.660179 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fb6210d0-153e-4297-992e-1eeabb2d7820 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:03.660702 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fb6210d0-153e-4297-992e-1eeabb2d7820 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:03.661132 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fb6210d0-153e-4297-992e-1eeabb2d7820 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:03.661927 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fb6210d0-153e-4297-992e-1eeabb2d7820 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:03.662380 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fb6210d0-153e-4297-992e-1eeabb2d7820 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:03.662805 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fb6210d0-153e-4297-992e-1eeabb2d7820 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:03.689622 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-fb6210d0-153e-4297-992e-1eeabb2d7820 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Going to try to terminate instance {{(pid=128305) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 16:04:03.741549 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-acb95683-6c1a-4cc3-8442-26043b3a10be tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:03.742192 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-acb95683-6c1a-4cc3-8442-26043b3a10be tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:03.748677 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-acb95683-6c1a-4cc3-8442-26043b3a10be tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:03.749151 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-acb95683-6c1a-4cc3-8442-26043b3a10be tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:03.749802 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-acb95683-6c1a-4cc3-8442-26043b3a10be tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:03.750487 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-acb95683-6c1a-4cc3-8442-26043b3a10be tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:03.750951 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-acb95683-6c1a-4cc3-8442-26043b3a10be tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:03.751382 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-acb95683-6c1a-4cc3-8442-26043b3a10be tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:03.898549 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-acb95683-6c1a-4cc3-8442-26043b3a10be tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:03.908046 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-acb95683-6c1a-4cc3-8442-26043b3a10be tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:03.909681 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-acb95683-6c1a-4cc3-8442-26043b3a10be tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:03.910839 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-acb95683-6c1a-4cc3-8442-26043b3a10be tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1674 microversion: 2.20 time: 0.173180 Aug 26 16:04:03.911419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 526/1070] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:04:03 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:04:04.071368 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-fb6210d0-153e-4297-992e-1eeabb2d7820 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "DELETE /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 204 len: 0 microversion: 2.1 time: 0.422081 Aug 26 16:04:04.072405 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 545/1071] 10.222.0.94 () {58 vars in 1239 bytes} [Fri Aug 26 16:04:03 2022] DELETE /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 16:04:04.081350 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-bdebb886-a8ff-4847-87ee-ee11ebcd767f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:04.082057 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-bdebb886-a8ff-4847-87ee-ee11ebcd767f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:04.088150 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bdebb886-a8ff-4847-87ee-ee11ebcd767f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:04.088666 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bdebb886-a8ff-4847-87ee-ee11ebcd767f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:04.089112 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bdebb886-a8ff-4847-87ee-ee11ebcd767f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:04.089807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bdebb886-a8ff-4847-87ee-ee11ebcd767f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:04.090265 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bdebb886-a8ff-4847-87ee-ee11ebcd767f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:04.090813 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bdebb886-a8ff-4847-87ee-ee11ebcd767f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:04.224349 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-bdebb886-a8ff-4847-87ee-ee11ebcd767f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:04.232262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-bdebb886-a8ff-4847-87ee-ee11ebcd767f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1673 microversion: 2.1 time: 0.154876 Aug 26 16:04:04.232978 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 527/1072] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:04 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:04.934542 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-d12b2d6f-7376-4c46-865b-f120d6bb7b62 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:04.935443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-d12b2d6f-7376-4c46-865b-f120d6bb7b62 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:04.942134 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d12b2d6f-7376-4c46-865b-f120d6bb7b62 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:04.942871 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d12b2d6f-7376-4c46-865b-f120d6bb7b62 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:04.943473 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d12b2d6f-7376-4c46-865b-f120d6bb7b62 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:04.944061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d12b2d6f-7376-4c46-865b-f120d6bb7b62 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:04.944521 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d12b2d6f-7376-4c46-865b-f120d6bb7b62 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:04.944954 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d12b2d6f-7376-4c46-865b-f120d6bb7b62 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:05.077686 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d12b2d6f-7376-4c46-865b-f120d6bb7b62 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:05.086062 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d12b2d6f-7376-4c46-865b-f120d6bb7b62 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:05.087527 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d12b2d6f-7376-4c46-865b-f120d6bb7b62 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:05.088718 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-d12b2d6f-7376-4c46-865b-f120d6bb7b62 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1732 microversion: 2.20 time: 0.158953 Aug 26 16:04:05.089530 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 546/1073] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:04:04 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:04:05.253172 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-c2d5480d-75f3-40de-884d-b63838b2b2b1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:05.253790 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-c2d5480d-75f3-40de-884d-b63838b2b2b1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:05.260347 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c2d5480d-75f3-40de-884d-b63838b2b2b1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:05.260838 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c2d5480d-75f3-40de-884d-b63838b2b2b1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:05.261277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c2d5480d-75f3-40de-884d-b63838b2b2b1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:05.261973 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c2d5480d-75f3-40de-884d-b63838b2b2b1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:05.262973 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c2d5480d-75f3-40de-884d-b63838b2b2b1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:05.263388 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c2d5480d-75f3-40de-884d-b63838b2b2b1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:05.400223 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-c2d5480d-75f3-40de-884d-b63838b2b2b1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:05.408810 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-c2d5480d-75f3-40de-884d-b63838b2b2b1 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1673 microversion: 2.1 time: 0.159604 Aug 26 16:04:05.409372 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 528/1074] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:05 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:06.113345 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-d1b7f4d2-9e37-489c-b7b3-f37e81ca7c25 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:06.119647 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-d1b7f4d2-9e37-489c-b7b3-f37e81ca7c25 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:06.120620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d1b7f4d2-9e37-489c-b7b3-f37e81ca7c25 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:06.121195 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d1b7f4d2-9e37-489c-b7b3-f37e81ca7c25 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:06.121679 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d1b7f4d2-9e37-489c-b7b3-f37e81ca7c25 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:06.123005 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d1b7f4d2-9e37-489c-b7b3-f37e81ca7c25 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:06.123679 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d1b7f4d2-9e37-489c-b7b3-f37e81ca7c25 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:06.124105 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d1b7f4d2-9e37-489c-b7b3-f37e81ca7c25 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:06.143710 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=6,nova_cell1:UPDATE=6 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:04:06.259854 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d1b7f4d2-9e37-489c-b7b3-f37e81ca7c25 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:06.268496 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d1b7f4d2-9e37-489c-b7b3-f37e81ca7c25 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:06.270019 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d1b7f4d2-9e37-489c-b7b3-f37e81ca7c25 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:06.271212 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-d1b7f4d2-9e37-489c-b7b3-f37e81ca7c25 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1732 microversion: 2.20 time: 0.162327 Aug 26 16:04:06.271768 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 547/1075] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:04:06 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:04:06.429853 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-04239312-acdf-4259-9a9c-40f150a864f3 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:06.430489 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-04239312-acdf-4259-9a9c-40f150a864f3 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:06.437734 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-04239312-acdf-4259-9a9c-40f150a864f3 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:06.438360 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-04239312-acdf-4259-9a9c-40f150a864f3 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:06.438803 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-04239312-acdf-4259-9a9c-40f150a864f3 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:06.439967 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-04239312-acdf-4259-9a9c-40f150a864f3 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:06.440434 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-04239312-acdf-4259-9a9c-40f150a864f3 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:06.440896 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-04239312-acdf-4259-9a9c-40f150a864f3 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:06.578280 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-04239312-acdf-4259-9a9c-40f150a864f3 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:06.586282 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-04239312-acdf-4259-9a9c-40f150a864f3 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1673 microversion: 2.1 time: 0.160259 Aug 26 16:04:06.586855 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 529/1076] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:06 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:07.296594 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-5ea89056-eb6d-4515-b847-c494b7554298 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:07.297212 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-5ea89056-eb6d-4515-b847-c494b7554298 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:07.304554 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5ea89056-eb6d-4515-b847-c494b7554298 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:07.308163 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5ea89056-eb6d-4515-b847-c494b7554298 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:07.308163 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5ea89056-eb6d-4515-b847-c494b7554298 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:07.308163 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5ea89056-eb6d-4515-b847-c494b7554298 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:07.308163 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5ea89056-eb6d-4515-b847-c494b7554298 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:07.308586 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5ea89056-eb6d-4515-b847-c494b7554298 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:07.526258 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-5ea89056-eb6d-4515-b847-c494b7554298 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:07.534082 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-5ea89056-eb6d-4515-b847-c494b7554298 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:07.537603 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-5ea89056-eb6d-4515-b847-c494b7554298 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:07.539154 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-5ea89056-eb6d-4515-b847-c494b7554298 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1732 microversion: 2.20 time: 0.247892 Aug 26 16:04:07.540209 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 548/1077] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:04:07 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1732 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:04:07.592090 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-e4ca98bb-23da-4441-ac22-d67204e26895 req-bdf38e26-14d7-42c5-8adc-a37c4bfa1dbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c945896-ccdd-42e4-a22c-b21e453512ff", "name": "network-vif-deleted", "tag": "6125da79-8738-4060-8d3d-5484c0e0a462"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:04:07.608489 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-b6692c46-0224-4383-bddb-dfc771bb84eb tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:07.609117 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-b6692c46-0224-4383-bddb-dfc771bb84eb tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:07.612976 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-e4ca98bb-23da-4441-ac22-d67204e26895 req-bdf38e26-14d7-42c5-8adc-a37c4bfa1dbb service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:07.614618 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-e4ca98bb-23da-4441-ac22-d67204e26895 req-bdf38e26-14d7-42c5-8adc-a37c4bfa1dbb service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:07.615271 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-e4ca98bb-23da-4441-ac22-d67204e26895 req-bdf38e26-14d7-42c5-8adc-a37c4bfa1dbb service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:07.620242 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b6692c46-0224-4383-bddb-dfc771bb84eb tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:07.620782 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b6692c46-0224-4383-bddb-dfc771bb84eb tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:07.622942 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b6692c46-0224-4383-bddb-dfc771bb84eb tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:07.625196 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b6692c46-0224-4383-bddb-dfc771bb84eb tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:07.633029 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b6692c46-0224-4383-bddb-dfc771bb84eb tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:07.633029 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b6692c46-0224-4383-bddb-dfc771bb84eb tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:07.640802 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-e4ca98bb-23da-4441-ac22-d67204e26895 req-bdf38e26-14d7-42c5-8adc-a37c4bfa1dbb service nova] Creating event network-vif-deleted:6125da79-8738-4060-8d3d-5484c0e0a462 for instance 4c945896-ccdd-42e4-a22c-b21e453512ff on hv-cinder-85144 Aug 26 16:04:07.648856 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-e4ca98bb-23da-4441-ac22-d67204e26895 req-bdf38e26-14d7-42c5-8adc-a37c4bfa1dbb service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065557 Aug 26 16:04:07.649743 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 530/1078] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:04:07.714122 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b6692c46-0224-4383-bddb-dfc771bb84eb tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:07.722630 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-b6692c46-0224-4383-bddb-dfc771bb84eb tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1605 microversion: 2.1 time: 0.118838 Aug 26 16:04:07.723475 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 549/1079] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:07 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1605 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:04:08.568713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-df6346b2-b28d-434b-9e67-9ec15f9919f0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:08.569454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-df6346b2-b28d-434b-9e67-9ec15f9919f0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:08.581163 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-df6346b2-b28d-434b-9e67-9ec15f9919f0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:08.582320 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-df6346b2-b28d-434b-9e67-9ec15f9919f0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:08.583033 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-df6346b2-b28d-434b-9e67-9ec15f9919f0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:08.584495 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-df6346b2-b28d-434b-9e67-9ec15f9919f0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:08.585372 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-df6346b2-b28d-434b-9e67-9ec15f9919f0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:08.586190 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-df6346b2-b28d-434b-9e67-9ec15f9919f0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:08.747256 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-6b260606-fc03-4291-8c22-6a1eb3e1a7d7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:08.748150 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-6b260606-fc03-4291-8c22-6a1eb3e1a7d7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:08.784347 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6b260606-fc03-4291-8c22-6a1eb3e1a7d7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:08.784873 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6b260606-fc03-4291-8c22-6a1eb3e1a7d7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:08.791155 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6b260606-fc03-4291-8c22-6a1eb3e1a7d7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:08.791940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6b260606-fc03-4291-8c22-6a1eb3e1a7d7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:08.792435 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6b260606-fc03-4291-8c22-6a1eb3e1a7d7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:08.792889 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6b260606-fc03-4291-8c22-6a1eb3e1a7d7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:08.811746 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-df6346b2-b28d-434b-9e67-9ec15f9919f0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:08.824967 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-df6346b2-b28d-434b-9e67-9ec15f9919f0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:08.829403 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-df6346b2-b28d-434b-9e67-9ec15f9919f0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:08.832491 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-df6346b2-b28d-434b-9e67-9ec15f9919f0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1732 microversion: 2.20 time: 0.271863 Aug 26 16:04:08.836101 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 531/1080] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:04:08 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1732 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:04:08.845105 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6b260606-fc03-4291-8c22-6a1eb3e1a7d7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:08.845598 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6b260606-fc03-4291-8c22-6a1eb3e1a7d7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:08.846161 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6b260606-fc03-4291-8c22-6a1eb3e1a7d7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:08.846615 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-6b260606-fc03-4291-8c22-6a1eb3e1a7d7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lazy-loading 'fault' on Instance uuid 4c945896-ccdd-42e4-a22c-b21e453512ff {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:04:08.909016 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-6b260606-fc03-4291-8c22-6a1eb3e1a7d7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:08.917618 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-6b260606-fc03-4291-8c22-6a1eb3e1a7d7 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1328 microversion: 2.1 time: 0.176227 Aug 26 16:04:08.919071 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 550/1081] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:08 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1328 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:09.860072 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-2037e9ab-498e-401e-9090-73b0379d920d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:09.860722 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-2037e9ab-498e-401e-9090-73b0379d920d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:09.867294 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2037e9ab-498e-401e-9090-73b0379d920d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:09.867818 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2037e9ab-498e-401e-9090-73b0379d920d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:09.868261 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2037e9ab-498e-401e-9090-73b0379d920d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:09.868960 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2037e9ab-498e-401e-9090-73b0379d920d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:09.869416 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2037e9ab-498e-401e-9090-73b0379d920d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:09.869840 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-2037e9ab-498e-401e-9090-73b0379d920d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:09.947403 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-487de376-30b7-4102-a777-29c70e60bded tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:09.948066 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-487de376-30b7-4102-a777-29c70e60bded tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:09.955304 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-487de376-30b7-4102-a777-29c70e60bded tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:09.955986 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-487de376-30b7-4102-a777-29c70e60bded tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:09.956714 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-487de376-30b7-4102-a777-29c70e60bded tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:09.957493 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-487de376-30b7-4102-a777-29c70e60bded tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:09.957956 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-487de376-30b7-4102-a777-29c70e60bded tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:09.958408 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-487de376-30b7-4102-a777-29c70e60bded tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:10.002486 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-487de376-30b7-4102-a777-29c70e60bded tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:10.003898 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-487de376-30b7-4102-a777-29c70e60bded tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:10.004525 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-487de376-30b7-4102-a777-29c70e60bded tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:10.005139 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-487de376-30b7-4102-a777-29c70e60bded tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lazy-loading 'fault' on Instance uuid 4c945896-ccdd-42e4-a22c-b21e453512ff {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:04:10.052791 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-2037e9ab-498e-401e-9090-73b0379d920d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:10.066404 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-2037e9ab-498e-401e-9090-73b0379d920d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:10.069503 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-2037e9ab-498e-401e-9090-73b0379d920d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:10.070499 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-487de376-30b7-4102-a777-29c70e60bded tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:10.072852 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-2037e9ab-498e-401e-9090-73b0379d920d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1732 microversion: 2.20 time: 0.216597 Aug 26 16:04:10.073703 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 532/1082] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:04:09 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1732 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:04:10.079280 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-487de376-30b7-4102-a777-29c70e60bded tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1328 microversion: 2.1 time: 0.136784 Aug 26 16:04:10.083274 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 551/1083] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:09 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1328 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:11.100123 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-1311fe60-c19e-453b-8460-c1f307c62bcc tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:11.101515 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-1311fe60-c19e-453b-8460-c1f307c62bcc tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:11.101860 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-831d34fa-6f44-44bd-a4b1-c7bc1ce31f53 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:11.103210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-831d34fa-6f44-44bd-a4b1-c7bc1ce31f53 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:11.110437 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1311fe60-c19e-453b-8460-c1f307c62bcc tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:11.112130 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1311fe60-c19e-453b-8460-c1f307c62bcc tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:11.112130 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1311fe60-c19e-453b-8460-c1f307c62bcc tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:11.112361 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-831d34fa-6f44-44bd-a4b1-c7bc1ce31f53 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:11.112490 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-831d34fa-6f44-44bd-a4b1-c7bc1ce31f53 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:11.113109 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-831d34fa-6f44-44bd-a4b1-c7bc1ce31f53 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:11.113802 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1311fe60-c19e-453b-8460-c1f307c62bcc tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:11.114173 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-831d34fa-6f44-44bd-a4b1-c7bc1ce31f53 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:11.114465 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1311fe60-c19e-453b-8460-c1f307c62bcc tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:11.115027 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1311fe60-c19e-453b-8460-c1f307c62bcc tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:11.115152 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-831d34fa-6f44-44bd-a4b1-c7bc1ce31f53 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:11.115720 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-831d34fa-6f44-44bd-a4b1-c7bc1ce31f53 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:11.172522 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1311fe60-c19e-453b-8460-c1f307c62bcc tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:11.175001 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1311fe60-c19e-453b-8460-c1f307c62bcc tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:11.176690 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1311fe60-c19e-453b-8460-c1f307c62bcc tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:11.177164 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.objects.instance [None req-1311fe60-c19e-453b-8460-c1f307c62bcc tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lazy-loading 'fault' on Instance uuid 4c945896-ccdd-42e4-a22c-b21e453512ff {{(pid=128304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:04:11.249720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-1311fe60-c19e-453b-8460-c1f307c62bcc tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:11.272772 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-1311fe60-c19e-453b-8460-c1f307c62bcc tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1328 microversion: 2.1 time: 0.176565 Aug 26 16:04:11.283050 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 533/1084] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:11 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1328 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:11.332015 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-831d34fa-6f44-44bd-a4b1-c7bc1ce31f53 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:11.341420 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-831d34fa-6f44-44bd-a4b1-c7bc1ce31f53 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:11.343031 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-831d34fa-6f44-44bd-a4b1-c7bc1ce31f53 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:11.346890 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-831d34fa-6f44-44bd-a4b1-c7bc1ce31f53 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1732 microversion: 2.20 time: 0.246717 Aug 26 16:04:11.346890 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 552/1085] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:04:11 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1732 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:04:12.300250 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7a4b2960-b8fa-4077-8a77-2e3fc066242c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:12.301427 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-7a4b2960-b8fa-4077-8a77-2e3fc066242c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:12.308826 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7a4b2960-b8fa-4077-8a77-2e3fc066242c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:12.309390 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7a4b2960-b8fa-4077-8a77-2e3fc066242c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:12.311412 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7a4b2960-b8fa-4077-8a77-2e3fc066242c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:12.312206 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7a4b2960-b8fa-4077-8a77-2e3fc066242c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:12.312734 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7a4b2960-b8fa-4077-8a77-2e3fc066242c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:12.313245 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7a4b2960-b8fa-4077-8a77-2e3fc066242c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:12.348072 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7a4b2960-b8fa-4077-8a77-2e3fc066242c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:12.348659 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7a4b2960-b8fa-4077-8a77-2e3fc066242c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:12.349102 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7a4b2960-b8fa-4077-8a77-2e3fc066242c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:12.349548 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.objects.instance [None req-7a4b2960-b8fa-4077-8a77-2e3fc066242c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lazy-loading 'fault' on Instance uuid 4c945896-ccdd-42e4-a22c-b21e453512ff {{(pid=128304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:04:12.352510 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:04:12.367244 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-09d9e228-54a9-4cc1-8976-200c2dedc173 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:12.368658 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-09d9e228-54a9-4cc1-8976-200c2dedc173 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:12.379919 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-09d9e228-54a9-4cc1-8976-200c2dedc173 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:12.385197 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-09d9e228-54a9-4cc1-8976-200c2dedc173 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:12.386586 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-09d9e228-54a9-4cc1-8976-200c2dedc173 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:12.388602 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-09d9e228-54a9-4cc1-8976-200c2dedc173 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:12.391490 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-09d9e228-54a9-4cc1-8976-200c2dedc173 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:12.392537 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-09d9e228-54a9-4cc1-8976-200c2dedc173 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:12.397106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7a4b2960-b8fa-4077-8a77-2e3fc066242c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:12.410629 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-7a4b2960-b8fa-4077-8a77-2e3fc066242c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1328 microversion: 2.1 time: 0.110250 Aug 26 16:04:12.410629 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 534/1086] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:12 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1328 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:12.549571 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-09d9e228-54a9-4cc1-8976-200c2dedc173 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:12.557866 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-09d9e228-54a9-4cc1-8976-200c2dedc173 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:12.559308 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-09d9e228-54a9-4cc1-8976-200c2dedc173 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:12.561064 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-09d9e228-54a9-4cc1-8976-200c2dedc173 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1732 microversion: 2.20 time: 0.198262 Aug 26 16:04:12.562146 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 553/1087] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:04:12 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1732 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:04:13.433300 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7390bbb8-7c12-4fb0-b18a-22f31ecd56f4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:13.433962 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-7390bbb8-7c12-4fb0-b18a-22f31ecd56f4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:13.448792 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7390bbb8-7c12-4fb0-b18a-22f31ecd56f4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:13.448792 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7390bbb8-7c12-4fb0-b18a-22f31ecd56f4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:13.448792 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7390bbb8-7c12-4fb0-b18a-22f31ecd56f4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:13.448792 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7390bbb8-7c12-4fb0-b18a-22f31ecd56f4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:13.449291 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7390bbb8-7c12-4fb0-b18a-22f31ecd56f4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:13.449291 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7390bbb8-7c12-4fb0-b18a-22f31ecd56f4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:13.501800 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7390bbb8-7c12-4fb0-b18a-22f31ecd56f4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:13.502376 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7390bbb8-7c12-4fb0-b18a-22f31ecd56f4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:13.520662 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7390bbb8-7c12-4fb0-b18a-22f31ecd56f4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:13.520662 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.objects.instance [None req-7390bbb8-7c12-4fb0-b18a-22f31ecd56f4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lazy-loading 'fault' on Instance uuid 4c945896-ccdd-42e4-a22c-b21e453512ff {{(pid=128304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:04:13.583648 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7390bbb8-7c12-4fb0-b18a-22f31ecd56f4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:13.584822 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-59d59bef-a798-429c-9377-01791e75f763 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:13.585494 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-59d59bef-a798-429c-9377-01791e75f763 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:13.593932 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-59d59bef-a798-429c-9377-01791e75f763 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:13.594557 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-7390bbb8-7c12-4fb0-b18a-22f31ecd56f4 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1328 microversion: 2.1 time: 0.165758 Aug 26 16:04:13.595042 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-59d59bef-a798-429c-9377-01791e75f763 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:13.595655 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-59d59bef-a798-429c-9377-01791e75f763 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:13.595820 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 535/1088] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:13 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1328 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:04:13.596843 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-59d59bef-a798-429c-9377-01791e75f763 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:13.597312 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-59d59bef-a798-429c-9377-01791e75f763 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:13.597775 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-59d59bef-a798-429c-9377-01791e75f763 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:13.785000 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-59d59bef-a798-429c-9377-01791e75f763 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:13.796443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-59d59bef-a798-429c-9377-01791e75f763 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:13.798449 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-59d59bef-a798-429c-9377-01791e75f763 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:13.799696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-59d59bef-a798-429c-9377-01791e75f763 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1732 microversion: 2.20 time: 0.219272 Aug 26 16:04:13.800384 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 554/1089] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:04:13 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1732 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:04:14.618671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-bd7111e4-31fa-4b6d-a6fe-4eece3d28e2f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:14.619684 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-bd7111e4-31fa-4b6d-a6fe-4eece3d28e2f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:14.628811 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bd7111e4-31fa-4b6d-a6fe-4eece3d28e2f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:14.629416 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bd7111e4-31fa-4b6d-a6fe-4eece3d28e2f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:14.629950 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bd7111e4-31fa-4b6d-a6fe-4eece3d28e2f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:14.630789 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bd7111e4-31fa-4b6d-a6fe-4eece3d28e2f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:14.631530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bd7111e4-31fa-4b6d-a6fe-4eece3d28e2f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:14.632137 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bd7111e4-31fa-4b6d-a6fe-4eece3d28e2f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:14.671889 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bd7111e4-31fa-4b6d-a6fe-4eece3d28e2f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:14.672386 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bd7111e4-31fa-4b6d-a6fe-4eece3d28e2f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:14.672828 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bd7111e4-31fa-4b6d-a6fe-4eece3d28e2f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:14.673287 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.objects.instance [None req-bd7111e4-31fa-4b6d-a6fe-4eece3d28e2f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lazy-loading 'fault' on Instance uuid 4c945896-ccdd-42e4-a22c-b21e453512ff {{(pid=128304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:04:14.684650 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a0b8d1ba-39e5-4eb6-8663-78221ffd1cf3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-529809820"}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:04:14.685633 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a0b8d1ba-39e5-4eb6-8663-78221ffd1cf3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:14.694360 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a0b8d1ba-39e5-4eb6-8663-78221ffd1cf3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:14.695150 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a0b8d1ba-39e5-4eb6-8663-78221ffd1cf3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:14.695865 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a0b8d1ba-39e5-4eb6-8663-78221ffd1cf3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:14.699209 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a0b8d1ba-39e5-4eb6-8663-78221ffd1cf3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:14.699992 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a0b8d1ba-39e5-4eb6-8663-78221ffd1cf3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:14.700949 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a0b8d1ba-39e5-4eb6-8663-78221ffd1cf3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:14.744293 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-bd7111e4-31fa-4b6d-a6fe-4eece3d28e2f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:14.753984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-bd7111e4-31fa-4b6d-a6fe-4eece3d28e2f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1328 microversion: 2.1 time: 0.139995 Aug 26 16:04:14.755017 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 536/1090] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:14 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1328 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:14.828994 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-5f0c24a0-7ca6-4485-ae16-a5e31a76586a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:14.829928 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-5f0c24a0-7ca6-4485-ae16-a5e31a76586a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:14.840130 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5f0c24a0-7ca6-4485-ae16-a5e31a76586a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:14.841161 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5f0c24a0-7ca6-4485-ae16-a5e31a76586a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:14.841773 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5f0c24a0-7ca6-4485-ae16-a5e31a76586a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:14.842657 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5f0c24a0-7ca6-4485-ae16-a5e31a76586a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:14.843280 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5f0c24a0-7ca6-4485-ae16-a5e31a76586a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:14.843729 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5f0c24a0-7ca6-4485-ae16-a5e31a76586a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:14.861362 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.network.security_group_api [None req-a0b8d1ba-39e5-4eb6-8663-78221ffd1cf3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Removing security group d3fe6aa2-d26c-4b97-a6b7-c6d591e6d9e4 from port 9fafeb43-ac51-4d27-a7ea-6b8e26f031a0 Aug 26 16:04:15.089331 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-5f0c24a0-7ca6-4485-ae16-a5e31a76586a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:15.102352 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-5f0c24a0-7ca6-4485-ae16-a5e31a76586a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:15.105652 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-5f0c24a0-7ca6-4485-ae16-a5e31a76586a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:15.108846 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-5f0c24a0-7ca6-4485-ae16-a5e31a76586a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1732 microversion: 2.20 time: 0.286798 Aug 26 16:04:15.110033 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 537/1091] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:04:14 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1732 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:04:15.384752 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a0b8d1ba-39e5-4eb6-8663-78221ffd1cf3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "POST /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0/action" status: 202 len: 0 microversion: 2.1 time: 0.704038 Aug 26 16:04:15.389450 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 555/1092] 10.222.0.94 () {60 vars in 1278 bytes} [Fri Aug 26 16:04:14 2022] POST /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0/action => generated 0 bytes in 709 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 16:04:15.414025 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-20cae8fe-e2fa-4b12-8413-6ced8d6d8a6b req-abb3cf5e-7868-433f-805c-e9375de7b9a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d2e527f-8238-448e-bad8-72e6223612f0", "tag": "9fafeb43-ac51-4d27-a7ea-6b8e26f031a0"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:04:15.451250 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-20cae8fe-e2fa-4b12-8413-6ced8d6d8a6b req-abb3cf5e-7868-433f-805c-e9375de7b9a0 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:15.451620 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-20cae8fe-e2fa-4b12-8413-6ced8d6d8a6b req-abb3cf5e-7868-433f-805c-e9375de7b9a0 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:15.452060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-20cae8fe-e2fa-4b12-8413-6ced8d6d8a6b req-abb3cf5e-7868-433f-805c-e9375de7b9a0 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:15.472520 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-20cae8fe-e2fa-4b12-8413-6ced8d6d8a6b req-abb3cf5e-7868-433f-805c-e9375de7b9a0 service nova] Creating event network-changed:9fafeb43-ac51-4d27-a7ea-6b8e26f031a0 for instance 6d2e527f-8238-448e-bad8-72e6223612f0 on hv-cinder-85144 Aug 26 16:04:15.476448 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-20cae8fe-e2fa-4b12-8413-6ced8d6d8a6b req-abb3cf5e-7868-433f-805c-e9375de7b9a0 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066197 Aug 26 16:04:15.477508 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 538/1093] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:04:15.777643 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-e2dbd45f-c2e6-4bb3-8f5c-08e7d91f11f2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:15.778678 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-e2dbd45f-c2e6-4bb3-8f5c-08e7d91f11f2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:15.785754 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e2dbd45f-c2e6-4bb3-8f5c-08e7d91f11f2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:15.786651 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e2dbd45f-c2e6-4bb3-8f5c-08e7d91f11f2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:15.787367 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e2dbd45f-c2e6-4bb3-8f5c-08e7d91f11f2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:15.788792 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e2dbd45f-c2e6-4bb3-8f5c-08e7d91f11f2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:15.789482 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e2dbd45f-c2e6-4bb3-8f5c-08e7d91f11f2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:15.790129 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e2dbd45f-c2e6-4bb3-8f5c-08e7d91f11f2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:15.833924 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e2dbd45f-c2e6-4bb3-8f5c-08e7d91f11f2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:15.834419 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e2dbd45f-c2e6-4bb3-8f5c-08e7d91f11f2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:15.834856 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e2dbd45f-c2e6-4bb3-8f5c-08e7d91f11f2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:15.835354 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-e2dbd45f-c2e6-4bb3-8f5c-08e7d91f11f2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lazy-loading 'fault' on Instance uuid 4c945896-ccdd-42e4-a22c-b21e453512ff {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:04:15.893904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-e2dbd45f-c2e6-4bb3-8f5c-08e7d91f11f2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:15.898393 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-e2dbd45f-c2e6-4bb3-8f5c-08e7d91f11f2 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1328 microversion: 2.1 time: 0.126556 Aug 26 16:04:15.899228 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 556/1094] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:15 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1328 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:16.137132 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-e016a712-6ff6-447b-b40b-2b8a8a2a4bd7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:16.138949 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-e016a712-6ff6-447b-b40b-2b8a8a2a4bd7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:16.152392 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e016a712-6ff6-447b-b40b-2b8a8a2a4bd7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:16.152881 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e016a712-6ff6-447b-b40b-2b8a8a2a4bd7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:16.153584 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e016a712-6ff6-447b-b40b-2b8a8a2a4bd7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:16.154483 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e016a712-6ff6-447b-b40b-2b8a8a2a4bd7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:16.159763 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e016a712-6ff6-447b-b40b-2b8a8a2a4bd7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:16.167681 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e016a712-6ff6-447b-b40b-2b8a8a2a4bd7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:16.358530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e016a712-6ff6-447b-b40b-2b8a8a2a4bd7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:16.367882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e016a712-6ff6-447b-b40b-2b8a8a2a4bd7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:16.369311 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e016a712-6ff6-447b-b40b-2b8a8a2a4bd7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:16.370567 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-e016a712-6ff6-447b-b40b-2b8a8a2a4bd7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1732 microversion: 2.20 time: 0.239069 Aug 26 16:04:16.371579 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 539/1095] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:04:16 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1732 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:04:16.930779 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-b30e35cd-51b6-418e-955f-02498ccd1851 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:16.931607 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-b30e35cd-51b6-418e-955f-02498ccd1851 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:16.941133 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b30e35cd-51b6-418e-955f-02498ccd1851 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:16.942465 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b30e35cd-51b6-418e-955f-02498ccd1851 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:16.943466 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b30e35cd-51b6-418e-955f-02498ccd1851 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:16.944460 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b30e35cd-51b6-418e-955f-02498ccd1851 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:16.945448 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b30e35cd-51b6-418e-955f-02498ccd1851 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:16.946287 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b30e35cd-51b6-418e-955f-02498ccd1851 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:16.989107 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b30e35cd-51b6-418e-955f-02498ccd1851 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:16.990094 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b30e35cd-51b6-418e-955f-02498ccd1851 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:16.990729 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b30e35cd-51b6-418e-955f-02498ccd1851 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:16.991420 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-b30e35cd-51b6-418e-955f-02498ccd1851 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lazy-loading 'fault' on Instance uuid 4c945896-ccdd-42e4-a22c-b21e453512ff {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:04:17.068345 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b30e35cd-51b6-418e-955f-02498ccd1851 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:17.077692 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-b30e35cd-51b6-418e-955f-02498ccd1851 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1328 microversion: 2.1 time: 0.160310 Aug 26 16:04:17.091205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 557/1096] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:16 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1328 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:17.381436 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-b266962e-beca-4d39-91a4-fde51daee186 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:17.381436 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-b266962e-beca-4d39-91a4-fde51daee186 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:17.384960 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_api:SELECT=66 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:04:17.391036 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b266962e-beca-4d39-91a4-fde51daee186 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:17.391762 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b266962e-beca-4d39-91a4-fde51daee186 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:17.392272 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b266962e-beca-4d39-91a4-fde51daee186 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:17.398010 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-b058ad2e-295e-4988-9318-26f68d9efc0a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:17.398937 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-b058ad2e-295e-4988-9318-26f68d9efc0a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:17.402467 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b266962e-beca-4d39-91a4-fde51daee186 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:17.403375 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b266962e-beca-4d39-91a4-fde51daee186 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:17.404041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b266962e-beca-4d39-91a4-fde51daee186 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:17.415407 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b058ad2e-295e-4988-9318-26f68d9efc0a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:17.421620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b058ad2e-295e-4988-9318-26f68d9efc0a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:17.421620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b058ad2e-295e-4988-9318-26f68d9efc0a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:17.421620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b058ad2e-295e-4988-9318-26f68d9efc0a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:17.421620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b058ad2e-295e-4988-9318-26f68d9efc0a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:17.422044 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b058ad2e-295e-4988-9318-26f68d9efc0a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:17.549686 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.objects.instance [None req-b266962e-beca-4d39-91a4-fde51daee186 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lazy-loading 'services' on Instance uuid 6d2e527f-8238-448e-bad8-72e6223612f0 {{(pid=128304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:04:17.606024 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b058ad2e-295e-4988-9318-26f68d9efc0a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:17.616427 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b058ad2e-295e-4988-9318-26f68d9efc0a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:17.618885 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b058ad2e-295e-4988-9318-26f68d9efc0a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:17.621551 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-b058ad2e-295e-4988-9318-26f68d9efc0a tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1732 microversion: 2.20 time: 0.227884 Aug 26 16:04:17.623181 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 558/1097] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:04:17 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1732 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:04:17.628002 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-62b43326-c993-4c52-a444-7cb191c12cd8 req-805a1dcd-95fe-47c1-8498-bb04ae3140d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d2e527f-8238-448e-bad8-72e6223612f0", "tag": "9fafeb43-ac51-4d27-a7ea-6b8e26f031a0"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:04:17.638808 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-62b43326-c993-4c52-a444-7cb191c12cd8 req-805a1dcd-95fe-47c1-8498-bb04ae3140d0 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:17.639514 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-62b43326-c993-4c52-a444-7cb191c12cd8 req-805a1dcd-95fe-47c1-8498-bb04ae3140d0 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:17.640021 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-62b43326-c993-4c52-a444-7cb191c12cd8 req-805a1dcd-95fe-47c1-8498-bb04ae3140d0 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:17.655584 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-62b43326-c993-4c52-a444-7cb191c12cd8 req-805a1dcd-95fe-47c1-8498-bb04ae3140d0 service nova] Creating event network-changed:9fafeb43-ac51-4d27-a7ea-6b8e26f031a0 for instance 6d2e527f-8238-448e-bad8-72e6223612f0 on hv-cinder-85144 Aug 26 16:04:17.660895 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-62b43326-c993-4c52-a444-7cb191c12cd8 req-805a1dcd-95fe-47c1-8498-bb04ae3140d0 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036285 Aug 26 16:04:17.661610 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 559/1098] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:04:17.827104 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-b266962e-beca-4d39-91a4-fde51daee186 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "DELETE /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0/os-volume_attachments/d203491d-c486-4c20-8d92-3b93ef451322" status: 202 len: 0 microversion: 2.1 time: 0.451159 Aug 26 16:04:17.833266 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 540/1099] 10.222.0.94 () {58 vars in 1416 bytes} [Fri Aug 26 16:04:17 2022] DELETE /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0/os-volume_attachments/d203491d-c486-4c20-8d92-3b93ef451322 => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 16:04:17.837107 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-43c96958-bc98-4169-9271-87a04b66f995 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:17.839590 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-43c96958-bc98-4169-9271-87a04b66f995 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:17.846711 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-43c96958-bc98-4169-9271-87a04b66f995 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:17.847226 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-43c96958-bc98-4169-9271-87a04b66f995 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:17.847664 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-43c96958-bc98-4169-9271-87a04b66f995 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:17.848482 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-43c96958-bc98-4169-9271-87a04b66f995 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:17.848934 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-43c96958-bc98-4169-9271-87a04b66f995 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:17.849359 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-43c96958-bc98-4169-9271-87a04b66f995 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:17.882018 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-43c96958-bc98-4169-9271-87a04b66f995 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049478 Aug 26 16:04:17.882892 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 560/1100] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:04:17 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:04:18.100817 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-3ed68d8c-8ed8-409c-9ae6-5836e2f68f06 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:18.101518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-3ed68d8c-8ed8-409c-9ae6-5836e2f68f06 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:18.108134 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3ed68d8c-8ed8-409c-9ae6-5836e2f68f06 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:18.108617 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3ed68d8c-8ed8-409c-9ae6-5836e2f68f06 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:18.109055 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3ed68d8c-8ed8-409c-9ae6-5836e2f68f06 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:18.109756 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3ed68d8c-8ed8-409c-9ae6-5836e2f68f06 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:18.110209 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3ed68d8c-8ed8-409c-9ae6-5836e2f68f06 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:18.110637 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3ed68d8c-8ed8-409c-9ae6-5836e2f68f06 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:18.147654 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3ed68d8c-8ed8-409c-9ae6-5836e2f68f06 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:18.148139 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3ed68d8c-8ed8-409c-9ae6-5836e2f68f06 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:18.148574 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3ed68d8c-8ed8-409c-9ae6-5836e2f68f06 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:18.149032 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.objects.instance [None req-3ed68d8c-8ed8-409c-9ae6-5836e2f68f06 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lazy-loading 'fault' on Instance uuid 4c945896-ccdd-42e4-a22c-b21e453512ff {{(pid=128304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:04:18.191569 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-3ed68d8c-8ed8-409c-9ae6-5836e2f68f06 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:18.200867 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-3ed68d8c-8ed8-409c-9ae6-5836e2f68f06 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1328 microversion: 2.1 time: 0.103892 Aug 26 16:04:18.201464 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 541/1101] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:18 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1328 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:18.646019 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-67ecde27-6e1c-4942-afd7-86ecc0e27727 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:18.647466 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-67ecde27-6e1c-4942-afd7-86ecc0e27727 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:18.654529 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-67ecde27-6e1c-4942-afd7-86ecc0e27727 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:18.655042 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-67ecde27-6e1c-4942-afd7-86ecc0e27727 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:18.655479 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-67ecde27-6e1c-4942-afd7-86ecc0e27727 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:18.656178 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-67ecde27-6e1c-4942-afd7-86ecc0e27727 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:18.656738 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-67ecde27-6e1c-4942-afd7-86ecc0e27727 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:18.657131 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-67ecde27-6e1c-4942-afd7-86ecc0e27727 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:18.808170 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-67ecde27-6e1c-4942-afd7-86ecc0e27727 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:18.816891 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-67ecde27-6e1c-4942-afd7-86ecc0e27727 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:18.818581 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-67ecde27-6e1c-4942-afd7-86ecc0e27727 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:18.819829 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-67ecde27-6e1c-4942-afd7-86ecc0e27727 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1732 microversion: 2.20 time: 0.178033 Aug 26 16:04:18.820386 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 561/1102] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:04:18 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:04:18.894786 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-c79eb932-409e-468a-9a3d-45ed82a1d09f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:18.897105 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-c79eb932-409e-468a-9a3d-45ed82a1d09f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:18.904869 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c79eb932-409e-468a-9a3d-45ed82a1d09f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:18.905362 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c79eb932-409e-468a-9a3d-45ed82a1d09f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:18.905807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c79eb932-409e-468a-9a3d-45ed82a1d09f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:18.906517 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c79eb932-409e-468a-9a3d-45ed82a1d09f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:18.907001 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c79eb932-409e-468a-9a3d-45ed82a1d09f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:18.907432 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c79eb932-409e-468a-9a3d-45ed82a1d09f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:18.946761 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-c79eb932-409e-468a-9a3d-45ed82a1d09f tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055923 Aug 26 16:04:18.947365 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 542/1103] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:04:18 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:04:19.222760 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-ff8cfd8b-cea7-4aee-8fba-8d8824ec2a7f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:19.223317 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-ff8cfd8b-cea7-4aee-8fba-8d8824ec2a7f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:19.229258 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ff8cfd8b-cea7-4aee-8fba-8d8824ec2a7f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:19.229743 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ff8cfd8b-cea7-4aee-8fba-8d8824ec2a7f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:19.230178 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ff8cfd8b-cea7-4aee-8fba-8d8824ec2a7f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:19.230864 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ff8cfd8b-cea7-4aee-8fba-8d8824ec2a7f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:19.231951 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ff8cfd8b-cea7-4aee-8fba-8d8824ec2a7f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:19.232381 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ff8cfd8b-cea7-4aee-8fba-8d8824ec2a7f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:19.262194 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ff8cfd8b-cea7-4aee-8fba-8d8824ec2a7f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:19.262658 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ff8cfd8b-cea7-4aee-8fba-8d8824ec2a7f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:19.263125 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ff8cfd8b-cea7-4aee-8fba-8d8824ec2a7f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:19.263568 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-ff8cfd8b-cea7-4aee-8fba-8d8824ec2a7f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lazy-loading 'fault' on Instance uuid 4c945896-ccdd-42e4-a22c-b21e453512ff {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:04:19.307766 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-ff8cfd8b-cea7-4aee-8fba-8d8824ec2a7f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:19.315361 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-ff8cfd8b-cea7-4aee-8fba-8d8824ec2a7f tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1328 microversion: 2.1 time: 0.096524 Aug 26 16:04:19.315913 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 562/1104] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:19 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1328 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:19.843630 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-703411ed-addb-4cdc-8932-5a37f0269cd9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:19.844157 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-703411ed-addb-4cdc-8932-5a37f0269cd9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:19.850158 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-703411ed-addb-4cdc-8932-5a37f0269cd9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:19.850620 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-703411ed-addb-4cdc-8932-5a37f0269cd9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:19.851093 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-703411ed-addb-4cdc-8932-5a37f0269cd9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:19.851786 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-703411ed-addb-4cdc-8932-5a37f0269cd9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:19.852244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-703411ed-addb-4cdc-8932-5a37f0269cd9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:19.852670 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-703411ed-addb-4cdc-8932-5a37f0269cd9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:19.960427 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-9b5d53b2-95b7-46b3-bb5e-b2fadb464d65 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:19.962809 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-9b5d53b2-95b7-46b3-bb5e-b2fadb464d65 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:19.970050 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9b5d53b2-95b7-46b3-bb5e-b2fadb464d65 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:19.970781 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9b5d53b2-95b7-46b3-bb5e-b2fadb464d65 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:19.971247 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9b5d53b2-95b7-46b3-bb5e-b2fadb464d65 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:19.971947 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9b5d53b2-95b7-46b3-bb5e-b2fadb464d65 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:19.972401 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9b5d53b2-95b7-46b3-bb5e-b2fadb464d65 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:19.972828 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9b5d53b2-95b7-46b3-bb5e-b2fadb464d65 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:19.983421 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-703411ed-addb-4cdc-8932-5a37f0269cd9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:19.990696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=100 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:04:19.991643 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-703411ed-addb-4cdc-8932-5a37f0269cd9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:19.993114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-703411ed-addb-4cdc-8932-5a37f0269cd9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:19.994361 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-703411ed-addb-4cdc-8932-5a37f0269cd9 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1732 microversion: 2.20 time: 0.155705 Aug 26 16:04:19.994941 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 543/1105] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:04:19 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:04:20.004315 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-9b5d53b2-95b7-46b3-bb5e-b2fadb464d65 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048021 Aug 26 16:04:20.004874 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 563/1106] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:04:19 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:04:20.339209 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-3a2ad658-420b-47f9-b8ad-e1689187d08a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:20.339816 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-3a2ad658-420b-47f9-b8ad-e1689187d08a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:20.346419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3a2ad658-420b-47f9-b8ad-e1689187d08a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:20.346898 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3a2ad658-420b-47f9-b8ad-e1689187d08a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:20.347367 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3a2ad658-420b-47f9-b8ad-e1689187d08a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:20.348055 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3a2ad658-420b-47f9-b8ad-e1689187d08a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:20.348510 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3a2ad658-420b-47f9-b8ad-e1689187d08a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:20.348935 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3a2ad658-420b-47f9-b8ad-e1689187d08a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:20.379091 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3a2ad658-420b-47f9-b8ad-e1689187d08a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:20.379570 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3a2ad658-420b-47f9-b8ad-e1689187d08a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:20.380002 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3a2ad658-420b-47f9-b8ad-e1689187d08a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:20.380516 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.objects.instance [None req-3a2ad658-420b-47f9-b8ad-e1689187d08a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lazy-loading 'fault' on Instance uuid 4c945896-ccdd-42e4-a22c-b21e453512ff {{(pid=128304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:04:20.421770 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-3a2ad658-420b-47f9-b8ad-e1689187d08a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:20.429763 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-3a2ad658-420b-47f9-b8ad-e1689187d08a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1328 microversion: 2.1 time: 0.094378 Aug 26 16:04:20.430624 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 544/1107] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:20 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1328 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:21.016424 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-14928448-5aea-4a3c-9f21-5210125a3d36 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:21.017594 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7833be6a-9b5e-47c6-956d-408fc34c5880 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:21.018205 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-7833be6a-9b5e-47c6-956d-408fc34c5880 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:21.018576 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-14928448-5aea-4a3c-9f21-5210125a3d36 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:21.024773 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7833be6a-9b5e-47c6-956d-408fc34c5880 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:21.025175 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-14928448-5aea-4a3c-9f21-5210125a3d36 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:21.025296 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7833be6a-9b5e-47c6-956d-408fc34c5880 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:21.025656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-14928448-5aea-4a3c-9f21-5210125a3d36 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:21.025797 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7833be6a-9b5e-47c6-956d-408fc34c5880 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:21.026092 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-14928448-5aea-4a3c-9f21-5210125a3d36 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:21.026372 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7833be6a-9b5e-47c6-956d-408fc34c5880 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:21.026793 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-14928448-5aea-4a3c-9f21-5210125a3d36 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:21.026892 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7833be6a-9b5e-47c6-956d-408fc34c5880 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:21.027262 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7833be6a-9b5e-47c6-956d-408fc34c5880 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:21.027359 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-14928448-5aea-4a3c-9f21-5210125a3d36 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:21.027687 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-14928448-5aea-4a3c-9f21-5210125a3d36 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:21.058943 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-14928448-5aea-4a3c-9f21-5210125a3d36 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047034 Aug 26 16:04:21.059517 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 564/1108] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:04:21 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:04:21.167202 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7833be6a-9b5e-47c6-956d-408fc34c5880 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:21.176002 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7833be6a-9b5e-47c6-956d-408fc34c5880 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:21.177655 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7833be6a-9b5e-47c6-956d-408fc34c5880 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:21.178996 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-7833be6a-9b5e-47c6-956d-408fc34c5880 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1732 microversion: 2.20 time: 0.165430 Aug 26 16:04:21.179636 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 545/1109] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:04:21 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:04:21.451926 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-cce9183d-7be8-484c-9ca4-71972d621582 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:21.452573 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-cce9183d-7be8-484c-9ca4-71972d621582 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:21.458750 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cce9183d-7be8-484c-9ca4-71972d621582 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:21.459282 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cce9183d-7be8-484c-9ca4-71972d621582 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:21.459715 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cce9183d-7be8-484c-9ca4-71972d621582 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:21.460771 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cce9183d-7be8-484c-9ca4-71972d621582 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:21.461431 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cce9183d-7be8-484c-9ca4-71972d621582 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:21.461860 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cce9183d-7be8-484c-9ca4-71972d621582 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:21.498559 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cce9183d-7be8-484c-9ca4-71972d621582 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:21.499731 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cce9183d-7be8-484c-9ca4-71972d621582 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:21.500320 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cce9183d-7be8-484c-9ca4-71972d621582 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:21.500771 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-cce9183d-7be8-484c-9ca4-71972d621582 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lazy-loading 'fault' on Instance uuid 4c945896-ccdd-42e4-a22c-b21e453512ff {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:04:21.542526 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-cce9183d-7be8-484c-9ca4-71972d621582 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7069a9b54a3245b3ab9671730344e6d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c69c9fb12124d72954b8ab7ad024175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:21.551644 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-cce9183d-7be8-484c-9ca4-71972d621582 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 200 len: 1328 microversion: 2.1 time: 0.104057 Aug 26 16:04:21.552220 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 565/1110] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:21 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 1328 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:22.071815 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-464971a0-32f2-4063-9905-ad88f2256576 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:22.074214 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-464971a0-32f2-4063-9905-ad88f2256576 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:22.081072 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-464971a0-32f2-4063-9905-ad88f2256576 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:22.081561 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-464971a0-32f2-4063-9905-ad88f2256576 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:22.081999 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-464971a0-32f2-4063-9905-ad88f2256576 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:22.082724 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-464971a0-32f2-4063-9905-ad88f2256576 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:22.083327 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-464971a0-32f2-4063-9905-ad88f2256576 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:22.083759 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-464971a0-32f2-4063-9905-ad88f2256576 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:22.116916 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-464971a0-32f2-4063-9905-ad88f2256576 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049061 Aug 26 16:04:22.121902 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 546/1111] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:04:22 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:04:22.203436 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-38554a33-52a7-4b80-966c-9570e233d6f7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:22.205147 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-38554a33-52a7-4b80-966c-9570e233d6f7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:22.212203 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-38554a33-52a7-4b80-966c-9570e233d6f7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:22.212999 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-38554a33-52a7-4b80-966c-9570e233d6f7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:22.213138 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-38554a33-52a7-4b80-966c-9570e233d6f7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:22.213866 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-38554a33-52a7-4b80-966c-9570e233d6f7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:22.214328 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-38554a33-52a7-4b80-966c-9570e233d6f7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:22.214824 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-38554a33-52a7-4b80-966c-9570e233d6f7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:22.380247 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-38554a33-52a7-4b80-966c-9570e233d6f7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:22.392590 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-38554a33-52a7-4b80-966c-9570e233d6f7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:22.394350 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-38554a33-52a7-4b80-966c-9570e233d6f7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:22.395684 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-38554a33-52a7-4b80-966c-9570e233d6f7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1732 microversion: 2.20 time: 0.196664 Aug 26 16:04:22.396324 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 566/1112] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:04:22 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1732 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:04:22.580170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-e0c1d013-7fed-4077-90e0-06565562498c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:22.580997 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-e0c1d013-7fed-4077-90e0-06565562498c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:22.587910 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e0c1d013-7fed-4077-90e0-06565562498c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:22.588403 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e0c1d013-7fed-4077-90e0-06565562498c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:22.588845 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e0c1d013-7fed-4077-90e0-06565562498c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:22.589548 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e0c1d013-7fed-4077-90e0-06565562498c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:22.590008 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e0c1d013-7fed-4077-90e0-06565562498c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:22.590438 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e0c1d013-7fed-4077-90e0-06565562498c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:22.603917 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-e0c1d013-7fed-4077-90e0-06565562498c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] HTTP exception thrown: Instance 4c945896-ccdd-42e4-a22c-b21e453512ff could not be found. Aug 26 16:04:22.605542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-e0c1d013-7fed-4077-90e0-06565562498c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Request method failure captured: Aug 26 16:04:22.605542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff HTTP/1.1 Aug 26 16:04:22.605542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 16:04:22.605542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 16:04:22.605542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 16:04:22.605542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 0 Aug 26 16:04:22.605542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 16:04:22.605542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 16:04:22.605542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 16:04:22.605542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 16:04:22.605542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO0-uZaz_yI8Fg49dle3FpYUy1aJ0NnJxpD4O_IzcLsXjBlx-RJAMTxN5SJE7qQ5dMQ_t19b4V47Xy7w3YZjwfMxBPUM9w64mwEA_HXhitBdZDc4m_jadz8TKAx7O7WpinSOa0TLZUo_YeVpTFQpEDv2Sgn55PqSQsUwV_NAHhnYzUs Aug 26 16:04:22.605542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 16:04:22.605542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 16:04:22.605542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 16:04:22.605542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 16:04:22.605542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 16:04:22.605542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 16:04:22.605542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: 8c69c9fb12124d72954b8ab7ad024175 Aug 26 16:04:22.605542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-AttachVolumeTestJSON-1188349192 Aug 26 16:04:22.605542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 16:04:22.605542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 16:04:22.607087 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/8c69c9fb12124d72954b8ab7ad024175"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/8c69c9fb12124d72954b8ab7ad024175"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/8c69c9fb12124d72954b8ab7ad024175"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_8c69c9fb12124d72954b8ab7ad024175", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:04:22.607087 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-AttachVolumeTestJSON-1188349192 Aug 26 16:04:22.607087 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: 8c69c9fb12124d72954b8ab7ad024175 Aug 26 16:04:22.607087 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1188349192 Aug 26 16:04:22.607087 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-AttachVolumeTestJSON-1188349192-project Aug 26 16:04:22.607087 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 16:04:22.607087 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 16:04:22.607087 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: 7069a9b54a3245b3ab9671730344e6d3 Aug 26 16:04:22.607087 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-AttachVolumeTestJSON-1188349192-project Aug 26 16:04:22.607087 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: > Aug 26 16:04:22.607087 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Instance 4c945896-ccdd-42e4-a22c-b21e453512ff could not be found. Aug 26 16:04:22.607087 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'id': '4c945896-ccdd-42e4-a22c-b21e453512ff'} Aug 26 16:04:22.607904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:04:22.607904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:22.607904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:04:22.607904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:04:22.607904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:04:22.607904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:04:22.607904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:04:22.607904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:04:22.607904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:04:22.607904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:04:22.607904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c945896-ccdd-42e4-a22c-b21e453512ff could not be found. Aug 26 16:04:22.607904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:22.607904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:22.607904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:22.607904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:22.607904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:22.607904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:22.607904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:04:22.607904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:04:22.607904 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:04:22.609859 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:04:22.609859 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:04:22.609859 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:04:22.609859 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:04:22.609859 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:04:22.609859 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:04:22.609859 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:04:22.609859 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c945896-ccdd-42e4-a22c-b21e453512ff could not be found. Aug 26 16:04:22.609859 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:22.609859 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:22.609859 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:22.609859 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:22.609859 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:22.609859 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:22.609859 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:04:22.609859 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:04:22.609859 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c945896-ccdd-42e4-a22c-b21e453512ff could not be found. Aug 26 16:04:22.609859 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:22.611177 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-e0c1d013-7fed-4077-90e0-06565562498c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Returning 404 to user: Instance 4c945896-ccdd-42e4-a22c-b21e453512ff could not be found. {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:04:22.611177 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-e0c1d013-7fed-4077-90e0-06565562498c tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 404 len: 111 microversion: 2.1 time: 0.035637 Aug 26 16:04:22.611177 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 547/1113] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:22 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 16:04:22.618871 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-30818ef8-b05e-4e70-aba3-858326242a78 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '.version_select at 0x7f15d96da0d0>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:22.710768 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-30818ef8-b05e-4e70-aba3-858326242a78 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1101648721" status: 202 len: 0 microversion: 2.1 time: 0.096988 Aug 26 16:04:22.711403 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 567/1114] 10.222.0.94 () {58 vars in 1221 bytes} [Fri Aug 26 16:04:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1101648721 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 16:04:23.129690 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-827a0b50-5534-438e-85fb-48930c6007b0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:23.131908 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-827a0b50-5534-438e-85fb-48930c6007b0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:23.138533 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-827a0b50-5534-438e-85fb-48930c6007b0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:23.139331 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-827a0b50-5534-438e-85fb-48930c6007b0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:23.140369 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-827a0b50-5534-438e-85fb-48930c6007b0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:23.141442 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-827a0b50-5534-438e-85fb-48930c6007b0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:23.142396 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-827a0b50-5534-438e-85fb-48930c6007b0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:23.143066 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-827a0b50-5534-438e-85fb-48930c6007b0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:23.175885 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-827a0b50-5534-438e-85fb-48930c6007b0 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050483 Aug 26 16:04:23.177305 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 548/1115] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:04:23 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 16:04:23.188246 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-63e67cff-934a-45f6-b82c-4d9f4ba5c104 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:23.188916 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-63e67cff-934a-45f6-b82c-4d9f4ba5c104 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:23.195207 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63e67cff-934a-45f6-b82c-4d9f4ba5c104 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:23.195830 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63e67cff-934a-45f6-b82c-4d9f4ba5c104 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:23.196266 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63e67cff-934a-45f6-b82c-4d9f4ba5c104 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:23.196967 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63e67cff-934a-45f6-b82c-4d9f4ba5c104 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:23.197421 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63e67cff-934a-45f6-b82c-4d9f4ba5c104 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:23.197846 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-63e67cff-934a-45f6-b82c-4d9f4ba5c104 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:23.277294 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.wsgi [None req-63e67cff-934a-45f6-b82c-4d9f4ba5c104 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] HTTP exception thrown: Instance 6d2e527f-8238-448e-bad8-72e6223612f0 is not attached to volume d203491d-c486-4c20-8d92-3b93ef451322 Aug 26 16:04:23.284835 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-63e67cff-934a-45f6-b82c-4d9f4ba5c104 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Request method failure captured: Aug 26 16:04:23.284835 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: request: DELETE /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0/os-volume_attachments/d203491d-c486-4c20-8d92-3b93ef451322 HTTP/1.1 Aug 26 16:04:23.284835 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept: application/json Aug 26 16:04:23.284835 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept-Encoding: identity Aug 26 16:04:23.284835 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Connection: close Aug 26 16:04:23.284835 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Length: 0 Aug 26 16:04:23.284835 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Type: application/json Aug 26 16:04:23.284835 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Host: 10.222.0.94 Aug 26 16:04:23.284835 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Openstack-System-Scope: None Aug 26 16:04:23.284835 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: User-Agent: python-urllib3/1.26.11 Aug 26 16:04:23.284835 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Auth-Token: gAAAAABjCO5TOY1fuFi4YzZ5kdrr0OUM4ZjpcZQbc2wYRHhIzwKACgvItThnG3GUWRCe6fuyDQjm2zqviKWJy-or21rW5rZfRXuM_5O2ii4hqsjCy9Prg9p0S1Qrq__Hz9fC96b4X3Chh9s2KIdgcA_uRJfKzl7stqNqJBC6tzD5jSeO43jrn3Y Aug 26 16:04:23.284835 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Id: None Aug 26 16:04:23.284835 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Name: None Aug 26 16:04:23.284835 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Identity-Status: Confirmed Aug 26 16:04:23.284835 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Is-Admin-Project: True Aug 26 16:04:23.284835 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Id: default Aug 26 16:04:23.284835 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Name: Default Aug 26 16:04:23.284835 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Id: 070e0f497888488d863e2f63b87a31ff Aug 26 16:04:23.284835 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Name: tempest-TestMinimumBasicScenario-2098821400 Aug 26 16:04:23.284835 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Role: member,reader Aug 26 16:04:23.284835 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Roles: member,reader Aug 26 16:04:23.286455 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/070e0f497888488d863e2f63b87a31ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/070e0f497888488d863e2f63b87a31ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/070e0f497888488d863e2f63b87a31ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_070e0f497888488d863e2f63b87a31ff", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:04:23.286455 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant: tempest-TestMinimumBasicScenario-2098821400 Aug 26 16:04:23.286455 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Id: 070e0f497888488d863e2f63b87a31ff Aug 26 16:04:23.286455 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2098821400 Aug 26 16:04:23.286455 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User: tempest-TestMinimumBasicScenario-2098821400-project Aug 26 16:04:23.286455 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Id: default Aug 26 16:04:23.286455 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Name: Default Aug 26 16:04:23.286455 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Id: 36d61fd7e97d433e886aaf495f703751 Aug 26 16:04:23.286455 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Name: tempest-TestMinimumBasicScenario-2098821400-project Aug 26 16:04:23.286455 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: method: > Aug 26 16:04:23.286455 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: exception: Instance 6d2e527f-8238-448e-bad8-72e6223612f0 is not attached to volume d203491d-c486-4c20-8d92-3b93ef451322 Aug 26 16:04:23.287395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: action_args: {'server_id': '6d2e527f-8238-448e-bad8-72e6223612f0', 'id': 'd203491d-c486-4c20-8d92-3b93ef451322'} Aug 26 16:04:23.287395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:04:23.287395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:23.287395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 26 16:04:23.287395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 26 16:04:23.287395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 16:04:23.287395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 16:04:23.287395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 26 16:04:23.287395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 26 16:04:23.287395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d203491d-c486-4c20-8d92-3b93ef451322. Aug 26 16:04:23.287395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:23.287395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:23.287395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:23.287395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:23.287395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:23.287395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:23.287395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:04:23.287395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:04:23.287395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:04:23.288977 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:04:23.288977 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 26 16:04:23.288977 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 26 16:04:23.288977 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d2e527f-8238-448e-bad8-72e6223612f0 is not attached to volume d203491d-c486-4c20-8d92-3b93ef451322 Aug 26 16:04:23.288977 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:23.288977 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:23.288977 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:23.288977 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:23.288977 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:23.288977 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:23.288977 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:04:23.288977 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:04:23.288977 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d2e527f-8238-448e-bad8-72e6223612f0 is not attached to volume d203491d-c486-4c20-8d92-3b93ef451322 Aug 26 16:04:23.288977 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:23.288977 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-63e67cff-934a-45f6-b82c-4d9f4ba5c104 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Returning 404 to user: Instance 6d2e527f-8238-448e-bad8-72e6223612f0 is not attached to volume d203491d-c486-4c20-8d92-3b93ef451322 {{(pid=128305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:04:23.289955 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-63e67cff-934a-45f6-b82c-4d9f4ba5c104 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "DELETE /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0/os-volume_attachments/d203491d-c486-4c20-8d92-3b93ef451322" status: 404 len: 154 microversion: 2.1 time: 0.103869 Aug 26 16:04:23.289955 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 568/1116] 10.222.0.94 () {58 vars in 1416 bytes} [Fri Aug 26 16:04:23 2022] DELETE /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0/os-volume_attachments/d203491d-c486-4c20-8d92-3b93ef451322 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:04:23.419117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-5bc87bb1-c072-46bb-9192-9109427003e2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:23.419662 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-5bc87bb1-c072-46bb-9192-9109427003e2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:23.426453 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5bc87bb1-c072-46bb-9192-9109427003e2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:23.427103 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5bc87bb1-c072-46bb-9192-9109427003e2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:23.427553 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5bc87bb1-c072-46bb-9192-9109427003e2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:23.428666 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5bc87bb1-c072-46bb-9192-9109427003e2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:23.428756 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5bc87bb1-c072-46bb-9192-9109427003e2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:23.429436 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5bc87bb1-c072-46bb-9192-9109427003e2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:23.629798 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-5bc87bb1-c072-46bb-9192-9109427003e2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:23.638172 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-5bc87bb1-c072-46bb-9192-9109427003e2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:23.640392 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-5bc87bb1-c072-46bb-9192-9109427003e2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:23.641677 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-5bc87bb1-c072-46bb-9192-9109427003e2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1732 microversion: 2.20 time: 0.226648 Aug 26 16:04:23.642328 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 549/1117] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:04:23 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1732 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:04:24.319637 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-e5cce6df-edc8-4035-92a6-3c2168a6bf16 req-e9435084-d4ab-4d32-a2ae-0400ee29c978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fc0c879-6083-414b-b6ee-2046538f526f", "name": "network-vif-plugged", "status": "completed", "tag": "5921e1e6-5379-4181-b413-94122520d6d1"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:04:24.326972 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-e5cce6df-edc8-4035-92a6-3c2168a6bf16 req-e9435084-d4ab-4d32-a2ae-0400ee29c978 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:24.327486 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-e5cce6df-edc8-4035-92a6-3c2168a6bf16 req-e9435084-d4ab-4d32-a2ae-0400ee29c978 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:24.327907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-e5cce6df-edc8-4035-92a6-3c2168a6bf16 req-e9435084-d4ab-4d32-a2ae-0400ee29c978 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:24.338256 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-e5cce6df-edc8-4035-92a6-3c2168a6bf16 req-e9435084-d4ab-4d32-a2ae-0400ee29c978 service nova] Creating event network-vif-plugged:5921e1e6-5379-4181-b413-94122520d6d1 for instance 3fc0c879-6083-414b-b6ee-2046538f526f on hv-cinder-85144 Aug 26 16:04:24.344276 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-e5cce6df-edc8-4035-92a6-3c2168a6bf16 req-e9435084-d4ab-4d32-a2ae-0400ee29c978 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034768 Aug 26 16:04:24.344874 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 569/1118] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:04:24.494375 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-862417c7-e74b-41ef-adcf-4cf7a5ed3f2f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:24.494915 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-862417c7-e74b-41ef-adcf-4cf7a5ed3f2f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:24.502317 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-862417c7-e74b-41ef-adcf-4cf7a5ed3f2f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:24.502798 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-862417c7-e74b-41ef-adcf-4cf7a5ed3f2f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:24.503256 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-862417c7-e74b-41ef-adcf-4cf7a5ed3f2f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:24.503952 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-862417c7-e74b-41ef-adcf-4cf7a5ed3f2f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:24.504399 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-862417c7-e74b-41ef-adcf-4cf7a5ed3f2f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:24.504819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-862417c7-e74b-41ef-adcf-4cf7a5ed3f2f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:24.524467 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:04:24.531514 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-862417c7-e74b-41ef-adcf-4cf7a5ed3f2f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154/ips" status: 200 len: 149 microversion: 2.1 time: 0.041152 Aug 26 16:04:24.532098 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 550/1119] 10.222.0.94 () {58 vars in 1248 bytes} [Fri Aug 26 16:04:24 2022] GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:04:24.639733 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-32cbd35d-c5e8-4d83-b568-9e846c4b15bc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:24.643526 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-32cbd35d-c5e8-4d83-b568-9e846c4b15bc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:24.647045 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-32cbd35d-c5e8-4d83-b568-9e846c4b15bc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:24.647526 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-32cbd35d-c5e8-4d83-b568-9e846c4b15bc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:24.647952 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-32cbd35d-c5e8-4d83-b568-9e846c4b15bc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:24.648643 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-32cbd35d-c5e8-4d83-b568-9e846c4b15bc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:24.649108 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-32cbd35d-c5e8-4d83-b568-9e846c4b15bc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:24.649652 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-32cbd35d-c5e8-4d83-b568-9e846c4b15bc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:24.665268 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-3e78baed-9ab3-4170-b327-a915717f2dd1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:24.665872 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-3e78baed-9ab3-4170-b327-a915717f2dd1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:24.675156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3e78baed-9ab3-4170-b327-a915717f2dd1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:24.675889 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3e78baed-9ab3-4170-b327-a915717f2dd1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:24.676595 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3e78baed-9ab3-4170-b327-a915717f2dd1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:24.677530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3e78baed-9ab3-4170-b327-a915717f2dd1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:24.677648 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-32cbd35d-c5e8-4d83-b568-9e846c4b15bc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Going to try to terminate instance {{(pid=128305) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 16:04:24.678580 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3e78baed-9ab3-4170-b327-a915717f2dd1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:24.679257 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3e78baed-9ab3-4170-b327-a915717f2dd1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:24.829525 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-3e78baed-9ab3-4170-b327-a915717f2dd1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:24.839170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-3e78baed-9ab3-4170-b327-a915717f2dd1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:24.840942 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-3e78baed-9ab3-4170-b327-a915717f2dd1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:24.844571 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-3e78baed-9ab3-4170-b327-a915717f2dd1 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1732 microversion: 2.20 time: 0.181172 Aug 26 16:04:24.844571 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 551/1120] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:04:24 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:04:24.938201 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:04:25.032088 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-32cbd35d-c5e8-4d83-b568-9e846c4b15bc tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "DELETE /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 204 len: 0 microversion: 2.1 time: 0.396141 Aug 26 16:04:25.034316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 570/1121] 10.222.0.94 () {58 vars in 1239 bytes} [Fri Aug 26 16:04:24 2022] DELETE /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 16:04:25.045149 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-b1eac9de-2803-4f39-89dc-e935ae534c8c tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:25.045929 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-b1eac9de-2803-4f39-89dc-e935ae534c8c tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:25.052066 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b1eac9de-2803-4f39-89dc-e935ae534c8c tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:25.052558 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b1eac9de-2803-4f39-89dc-e935ae534c8c tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:25.053056 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b1eac9de-2803-4f39-89dc-e935ae534c8c tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:25.053772 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b1eac9de-2803-4f39-89dc-e935ae534c8c tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:25.054231 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b1eac9de-2803-4f39-89dc-e935ae534c8c tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:25.054827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b1eac9de-2803-4f39-89dc-e935ae534c8c tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:25.204953 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-b1eac9de-2803-4f39-89dc-e935ae534c8c tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:25.212388 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-b1eac9de-2803-4f39-89dc-e935ae534c8c tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1555 microversion: 2.1 time: 0.171818 Aug 26 16:04:25.213283 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 552/1122] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:25 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:25.866222 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-f6bea398-1d93-4233-b0fb-1372194f3c3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:25.866937 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-f6bea398-1d93-4233-b0fb-1372194f3c3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:25.873870 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f6bea398-1d93-4233-b0fb-1372194f3c3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:25.874346 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f6bea398-1d93-4233-b0fb-1372194f3c3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:25.874780 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f6bea398-1d93-4233-b0fb-1372194f3c3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:25.875499 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f6bea398-1d93-4233-b0fb-1372194f3c3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:25.875958 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f6bea398-1d93-4233-b0fb-1372194f3c3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:25.876380 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f6bea398-1d93-4233-b0fb-1372194f3c3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:26.006609 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-f6bea398-1d93-4233-b0fb-1372194f3c3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:26.014711 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-f6bea398-1d93-4233-b0fb-1372194f3c3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:26.016215 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-f6bea398-1d93-4233-b0fb-1372194f3c3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:26.017438 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-f6bea398-1d93-4233-b0fb-1372194f3c3b tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1732 microversion: 2.20 time: 0.155576 Aug 26 16:04:26.017983 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 571/1123] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:04:25 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:04:26.233029 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-5600d002-7e15-4153-956a-ce415b634c17 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:26.233651 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-5600d002-7e15-4153-956a-ce415b634c17 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:26.244153 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5600d002-7e15-4153-956a-ce415b634c17 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:26.244153 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5600d002-7e15-4153-956a-ce415b634c17 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:26.244153 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5600d002-7e15-4153-956a-ce415b634c17 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:26.244153 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5600d002-7e15-4153-956a-ce415b634c17 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:26.244525 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5600d002-7e15-4153-956a-ce415b634c17 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:26.244525 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5600d002-7e15-4153-956a-ce415b634c17 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:26.247131 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-163f8d31-de4c-4a39-a588-05e444563b61 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:26.247630 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-163f8d31-de4c-4a39-a588-05e444563b61 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:26.254143 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-163f8d31-de4c-4a39-a588-05e444563b61 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:26.254645 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-163f8d31-de4c-4a39-a588-05e444563b61 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:26.255123 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-163f8d31-de4c-4a39-a588-05e444563b61 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:26.255870 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-163f8d31-de4c-4a39-a588-05e444563b61 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:26.256319 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-163f8d31-de4c-4a39-a588-05e444563b61 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:26.256741 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-163f8d31-de4c-4a39-a588-05e444563b61 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:26.271896 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.wsgi [None req-163f8d31-de4c-4a39-a588-05e444563b61 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] HTTP exception thrown: Instance 4c945896-ccdd-42e4-a22c-b21e453512ff could not be found. Aug 26 16:04:26.273557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-163f8d31-de4c-4a39-a588-05e444563b61 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Request method failure captured: Aug 26 16:04:26.273557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: request: DELETE /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff HTTP/1.1 Aug 26 16:04:26.273557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept: application/json Aug 26 16:04:26.273557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept-Encoding: identity Aug 26 16:04:26.273557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Connection: close Aug 26 16:04:26.273557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Length: 0 Aug 26 16:04:26.273557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Type: application/json Aug 26 16:04:26.273557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Host: 10.222.0.94 Aug 26 16:04:26.273557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Openstack-System-Scope: None Aug 26 16:04:26.273557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: User-Agent: python-urllib3/1.26.11 Aug 26 16:04:26.273557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Auth-Token: gAAAAABjCO0-uZaz_yI8Fg49dle3FpYUy1aJ0NnJxpD4O_IzcLsXjBlx-RJAMTxN5SJE7qQ5dMQ_t19b4V47Xy7w3YZjwfMxBPUM9w64mwEA_HXhitBdZDc4m_jadz8TKAx7O7WpinSOa0TLZUo_YeVpTFQpEDv2Sgn55PqSQsUwV_NAHhnYzUs Aug 26 16:04:26.273557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Id: None Aug 26 16:04:26.273557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Name: None Aug 26 16:04:26.273557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Identity-Status: Confirmed Aug 26 16:04:26.273557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Is-Admin-Project: True Aug 26 16:04:26.273557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Id: default Aug 26 16:04:26.273557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Name: Default Aug 26 16:04:26.273557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Id: 8c69c9fb12124d72954b8ab7ad024175 Aug 26 16:04:26.273557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Name: tempest-AttachVolumeTestJSON-1188349192 Aug 26 16:04:26.273557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Role: member,reader Aug 26 16:04:26.273557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Roles: member,reader Aug 26 16:04:26.274876 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/8c69c9fb12124d72954b8ab7ad024175"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/8c69c9fb12124d72954b8ab7ad024175"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/8c69c9fb12124d72954b8ab7ad024175"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_8c69c9fb12124d72954b8ab7ad024175", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:04:26.274876 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant: tempest-AttachVolumeTestJSON-1188349192 Aug 26 16:04:26.274876 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Id: 8c69c9fb12124d72954b8ab7ad024175 Aug 26 16:04:26.274876 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1188349192 Aug 26 16:04:26.274876 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User: tempest-AttachVolumeTestJSON-1188349192-project Aug 26 16:04:26.274876 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Id: default Aug 26 16:04:26.274876 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Name: Default Aug 26 16:04:26.274876 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Id: 7069a9b54a3245b3ab9671730344e6d3 Aug 26 16:04:26.274876 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Name: tempest-AttachVolumeTestJSON-1188349192-project Aug 26 16:04:26.274876 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: method: > Aug 26 16:04:26.274876 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: exception: Instance 4c945896-ccdd-42e4-a22c-b21e453512ff could not be found. Aug 26 16:04:26.274876 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: action_args: {'id': '4c945896-ccdd-42e4-a22c-b21e453512ff'} Aug 26 16:04:26.277002 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:04:26.277002 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:26.277002 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:04:26.277002 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:04:26.277002 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:04:26.277002 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:04:26.277002 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:04:26.277002 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:04:26.277002 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:04:26.277002 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:04:26.277002 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c945896-ccdd-42e4-a22c-b21e453512ff could not be found. Aug 26 16:04:26.277002 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:26.277002 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:26.277002 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:26.277002 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:26.277002 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:26.277002 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:26.277002 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:04:26.277002 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:04:26.277002 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:04:26.278210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:04:26.278210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 16:04:26.278210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 16:04:26.278210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 16:04:26.278210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 16:04:26.278210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:04:26.278210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:04:26.278210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:04:26.278210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:04:26.278210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c945896-ccdd-42e4-a22c-b21e453512ff could not be found. Aug 26 16:04:26.278210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:26.278210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:26.278210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:26.278210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:26.278210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:26.278210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:26.278210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:04:26.278210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:04:26.278210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c945896-ccdd-42e4-a22c-b21e453512ff could not be found. Aug 26 16:04:26.278210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:26.285619 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-163f8d31-de4c-4a39-a588-05e444563b61 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Returning 404 to user: Instance 4c945896-ccdd-42e4-a22c-b21e453512ff could not be found. {{(pid=128305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:04:26.285619 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-163f8d31-de4c-4a39-a588-05e444563b61 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "DELETE /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 404 len: 111 microversion: 2.1 time: 0.031888 Aug 26 16:04:26.285619 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 572/1124] 10.222.0.94 () {58 vars in 1239 bytes} [Fri Aug 26 16:04:26 2022] DELETE /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:04:26.289956 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-42a30edc-0aac-4bf8-9da1-44f4859e6c1d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:26.290575 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-42a30edc-0aac-4bf8-9da1-44f4859e6c1d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: 4c945896-ccdd-42e4-a22c-b21e453512ff] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:26.296739 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-42a30edc-0aac-4bf8-9da1-44f4859e6c1d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:26.297231 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-42a30edc-0aac-4bf8-9da1-44f4859e6c1d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:26.297672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-42a30edc-0aac-4bf8-9da1-44f4859e6c1d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:26.298380 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-42a30edc-0aac-4bf8-9da1-44f4859e6c1d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:26.298831 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-42a30edc-0aac-4bf8-9da1-44f4859e6c1d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:26.299311 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-42a30edc-0aac-4bf8-9da1-44f4859e6c1d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:26.317940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.wsgi [None req-42a30edc-0aac-4bf8-9da1-44f4859e6c1d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] HTTP exception thrown: Instance 4c945896-ccdd-42e4-a22c-b21e453512ff could not be found. Aug 26 16:04:26.317940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-42a30edc-0aac-4bf8-9da1-44f4859e6c1d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Request method failure captured: Aug 26 16:04:26.317940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: request: GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff HTTP/1.1 Aug 26 16:04:26.317940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept: application/json Aug 26 16:04:26.317940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept-Encoding: identity Aug 26 16:04:26.317940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Connection: close Aug 26 16:04:26.317940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Length: 0 Aug 26 16:04:26.317940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Type: application/json Aug 26 16:04:26.317940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Host: 10.222.0.94 Aug 26 16:04:26.317940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Openstack-System-Scope: None Aug 26 16:04:26.317940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: User-Agent: python-urllib3/1.26.11 Aug 26 16:04:26.317940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Auth-Token: gAAAAABjCO0-uZaz_yI8Fg49dle3FpYUy1aJ0NnJxpD4O_IzcLsXjBlx-RJAMTxN5SJE7qQ5dMQ_t19b4V47Xy7w3YZjwfMxBPUM9w64mwEA_HXhitBdZDc4m_jadz8TKAx7O7WpinSOa0TLZUo_YeVpTFQpEDv2Sgn55PqSQsUwV_NAHhnYzUs Aug 26 16:04:26.317940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Id: None Aug 26 16:04:26.317940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Name: None Aug 26 16:04:26.317940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Identity-Status: Confirmed Aug 26 16:04:26.317940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Is-Admin-Project: True Aug 26 16:04:26.317940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Id: default Aug 26 16:04:26.317940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Name: Default Aug 26 16:04:26.317940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Id: 8c69c9fb12124d72954b8ab7ad024175 Aug 26 16:04:26.317940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Name: tempest-AttachVolumeTestJSON-1188349192 Aug 26 16:04:26.317940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Role: member,reader Aug 26 16:04:26.317940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Roles: member,reader Aug 26 16:04:26.319672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/8c69c9fb12124d72954b8ab7ad024175"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/8c69c9fb12124d72954b8ab7ad024175"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/8c69c9fb12124d72954b8ab7ad024175"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_8c69c9fb12124d72954b8ab7ad024175", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:04:26.319672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant: tempest-AttachVolumeTestJSON-1188349192 Aug 26 16:04:26.319672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Id: 8c69c9fb12124d72954b8ab7ad024175 Aug 26 16:04:26.319672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1188349192 Aug 26 16:04:26.319672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User: tempest-AttachVolumeTestJSON-1188349192-project Aug 26 16:04:26.319672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Id: default Aug 26 16:04:26.319672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Name: Default Aug 26 16:04:26.319672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Id: 7069a9b54a3245b3ab9671730344e6d3 Aug 26 16:04:26.319672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Name: tempest-AttachVolumeTestJSON-1188349192-project Aug 26 16:04:26.319672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: method: > Aug 26 16:04:26.319672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: exception: Instance 4c945896-ccdd-42e4-a22c-b21e453512ff could not be found. Aug 26 16:04:26.319672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: action_args: {'id': '4c945896-ccdd-42e4-a22c-b21e453512ff'} Aug 26 16:04:26.320390 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:04:26.320390 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:26.320390 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:04:26.320390 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:04:26.320390 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:04:26.320390 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:04:26.320390 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:04:26.320390 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:04:26.320390 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:04:26.320390 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:04:26.320390 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c945896-ccdd-42e4-a22c-b21e453512ff could not be found. Aug 26 16:04:26.320390 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:26.320390 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:26.320390 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:26.320390 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:26.320390 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:26.320390 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:26.320390 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:04:26.320390 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:04:26.320390 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:04:26.321557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:04:26.321557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:04:26.321557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:04:26.321557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:04:26.321557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:04:26.321557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:04:26.321557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:04:26.321557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c945896-ccdd-42e4-a22c-b21e453512ff could not be found. Aug 26 16:04:26.321557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:26.321557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:26.321557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:26.321557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:26.321557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:26.321557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:26.321557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:04:26.321557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:04:26.321557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c945896-ccdd-42e4-a22c-b21e453512ff could not be found. Aug 26 16:04:26.321557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:26.322652 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-42a30edc-0aac-4bf8-9da1-44f4859e6c1d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Returning 404 to user: Instance 4c945896-ccdd-42e4-a22c-b21e453512ff could not be found. {{(pid=128305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:04:26.322652 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-42a30edc-0aac-4bf8-9da1-44f4859e6c1d tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff" status: 404 len: 111 microversion: 2.1 time: 0.030543 Aug 26 16:04:26.322652 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 573/1125] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:26 2022] GET /compute/v2.1/servers/4c945896-ccdd-42e4-a22c-b21e453512ff => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 16:04:26.325492 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-145292f4-e802-41cd-b094-67405b676cae tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49677a68-be5c-47e7-8c1d-c2700f63f256"}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:04:26.329341 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-145292f4-e802-41cd-b094-67405b676cae tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:26.335492 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-145292f4-e802-41cd-b094-67405b676cae tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:26.340369 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-145292f4-e802-41cd-b094-67405b676cae tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:26.340830 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-145292f4-e802-41cd-b094-67405b676cae tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:26.342327 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-145292f4-e802-41cd-b094-67405b676cae tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:26.342759 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-145292f4-e802-41cd-b094-67405b676cae tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:26.352323 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-145292f4-e802-41cd-b094-67405b676cae tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:26.384065 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-5600d002-7e15-4153-956a-ce415b634c17 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:26.392435 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-5600d002-7e15-4153-956a-ce415b634c17 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1555 microversion: 2.1 time: 0.163264 Aug 26 16:04:26.393039 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 553/1126] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:26 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:27.041248 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-68f8e734-c06c-402e-ad53-8220e8785be3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:27.042012 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-68f8e734-c06c-402e-ad53-8220e8785be3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:27.048847 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-68f8e734-c06c-402e-ad53-8220e8785be3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:27.049526 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-68f8e734-c06c-402e-ad53-8220e8785be3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:27.049958 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-68f8e734-c06c-402e-ad53-8220e8785be3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:27.050647 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-68f8e734-c06c-402e-ad53-8220e8785be3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:27.051125 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-68f8e734-c06c-402e-ad53-8220e8785be3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:27.051736 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-68f8e734-c06c-402e-ad53-8220e8785be3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:27.191532 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-68f8e734-c06c-402e-ad53-8220e8785be3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:27.200143 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-68f8e734-c06c-402e-ad53-8220e8785be3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:27.201579 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-68f8e734-c06c-402e-ad53-8220e8785be3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:27.202870 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-68f8e734-c06c-402e-ad53-8220e8785be3 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1732 microversion: 2.20 time: 0.165601 Aug 26 16:04:27.203446 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 554/1127] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:04:27 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:04:27.415936 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-887527c3-9954-41e7-a99a-83d777d7bd59 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:27.416594 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-887527c3-9954-41e7-a99a-83d777d7bd59 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:27.423996 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-887527c3-9954-41e7-a99a-83d777d7bd59 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:27.424478 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-887527c3-9954-41e7-a99a-83d777d7bd59 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:27.424914 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-887527c3-9954-41e7-a99a-83d777d7bd59 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:27.425608 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-887527c3-9954-41e7-a99a-83d777d7bd59 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:27.426062 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-887527c3-9954-41e7-a99a-83d777d7bd59 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:27.426488 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-887527c3-9954-41e7-a99a-83d777d7bd59 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:27.567908 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-887527c3-9954-41e7-a99a-83d777d7bd59 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:27.584215 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-887527c3-9954-41e7-a99a-83d777d7bd59 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1555 microversion: 2.1 time: 0.169170 Aug 26 16:04:27.584215 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 555/1128] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:27 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:04:27.640549 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-a6e09b61-2e37-46a6-a51c-804183e33127 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:27.641056 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-a6e09b61-2e37-46a6-a51c-804183e33127 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:27.647382 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a6e09b61-2e37-46a6-a51c-804183e33127 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:27.651258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a6e09b61-2e37-46a6-a51c-804183e33127 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:27.651258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a6e09b61-2e37-46a6-a51c-804183e33127 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:27.651258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a6e09b61-2e37-46a6-a51c-804183e33127 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:27.651258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a6e09b61-2e37-46a6-a51c-804183e33127 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:27.651704 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a6e09b61-2e37-46a6-a51c-804183e33127 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:27.664408 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-a6e09b61-2e37-46a6-a51c-804183e33127 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] HTTP exception thrown: Instance f0e476ca-b4b7-4537-bfca-2c66b7246c3e could not be found. Aug 26 16:04:27.665807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-a6e09b61-2e37-46a6-a51c-804183e33127 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Request method failure captured: Aug 26 16:04:27.665807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: DELETE /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e HTTP/1.1 Aug 26 16:04:27.665807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 16:04:27.665807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 16:04:27.665807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 16:04:27.665807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 0 Aug 26 16:04:27.665807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 16:04:27.665807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 16:04:27.665807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 16:04:27.665807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 16:04:27.665807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO0-uZaz_yI8Fg49dle3FpYUy1aJ0NnJxpD4O_IzcLsXjBlx-RJAMTxN5SJE7qQ5dMQ_t19b4V47Xy7w3YZjwfMxBPUM9w64mwEA_HXhitBdZDc4m_jadz8TKAx7O7WpinSOa0TLZUo_YeVpTFQpEDv2Sgn55PqSQsUwV_NAHhnYzUs Aug 26 16:04:27.665807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 16:04:27.665807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 16:04:27.665807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 16:04:27.665807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 16:04:27.665807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 16:04:27.665807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 16:04:27.665807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: 8c69c9fb12124d72954b8ab7ad024175 Aug 26 16:04:27.665807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-AttachVolumeTestJSON-1188349192 Aug 26 16:04:27.665807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 16:04:27.665807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 16:04:27.667449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/8c69c9fb12124d72954b8ab7ad024175"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/8c69c9fb12124d72954b8ab7ad024175"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/8c69c9fb12124d72954b8ab7ad024175"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_8c69c9fb12124d72954b8ab7ad024175", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:04:27.667449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-AttachVolumeTestJSON-1188349192 Aug 26 16:04:27.667449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: 8c69c9fb12124d72954b8ab7ad024175 Aug 26 16:04:27.667449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1188349192 Aug 26 16:04:27.667449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-AttachVolumeTestJSON-1188349192-project Aug 26 16:04:27.667449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 16:04:27.667449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 16:04:27.667449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: 7069a9b54a3245b3ab9671730344e6d3 Aug 26 16:04:27.667449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-AttachVolumeTestJSON-1188349192-project Aug 26 16:04:27.667449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: > Aug 26 16:04:27.667449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Instance f0e476ca-b4b7-4537-bfca-2c66b7246c3e could not be found. Aug 26 16:04:27.667449 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'id': 'f0e476ca-b4b7-4537-bfca-2c66b7246c3e'} Aug 26 16:04:27.668444 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:04:27.668444 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:27.668444 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:04:27.668444 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:04:27.668444 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:04:27.668444 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:04:27.668444 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:04:27.668444 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:04:27.668444 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:04:27.668444 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:04:27.668444 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0e476ca-b4b7-4537-bfca-2c66b7246c3e could not be found. Aug 26 16:04:27.668444 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:27.668444 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:27.668444 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:27.668444 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:27.668444 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:27.668444 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:27.668444 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:04:27.668444 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:04:27.668444 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:04:27.670114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:04:27.670114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 16:04:27.670114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 16:04:27.670114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 16:04:27.670114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 16:04:27.670114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:04:27.670114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:04:27.670114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:04:27.670114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:04:27.670114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0e476ca-b4b7-4537-bfca-2c66b7246c3e could not be found. Aug 26 16:04:27.670114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:27.670114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:27.670114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:27.670114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:27.670114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:27.670114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:27.670114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:04:27.670114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:04:27.670114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0e476ca-b4b7-4537-bfca-2c66b7246c3e could not be found. Aug 26 16:04:27.670114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:27.672155 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-a6e09b61-2e37-46a6-a51c-804183e33127 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Returning 404 to user: Instance f0e476ca-b4b7-4537-bfca-2c66b7246c3e could not be found. {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:04:27.672155 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-a6e09b61-2e37-46a6-a51c-804183e33127 tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "DELETE /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 404 len: 111 microversion: 2.1 time: 0.030987 Aug 26 16:04:27.672155 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 556/1129] 10.222.0.94 () {58 vars in 1239 bytes} [Fri Aug 26 16:04:27 2022] DELETE /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 16:04:27.677747 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ebeec572-d548-4ad4-bdd0-9ad39166f59a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:27.677747 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ebeec572-d548-4ad4-bdd0-9ad39166f59a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] [instance: f0e476ca-b4b7-4537-bfca-2c66b7246c3e] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:27.683338 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebeec572-d548-4ad4-bdd0-9ad39166f59a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:27.683822 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebeec572-d548-4ad4-bdd0-9ad39166f59a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:27.684312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebeec572-d548-4ad4-bdd0-9ad39166f59a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:27.685011 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebeec572-d548-4ad4-bdd0-9ad39166f59a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:27.685464 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebeec572-d548-4ad4-bdd0-9ad39166f59a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:27.685890 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebeec572-d548-4ad4-bdd0-9ad39166f59a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:27.701059 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-ebeec572-d548-4ad4-bdd0-9ad39166f59a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] HTTP exception thrown: Instance f0e476ca-b4b7-4537-bfca-2c66b7246c3e could not be found. Aug 26 16:04:27.709156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ebeec572-d548-4ad4-bdd0-9ad39166f59a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Request method failure captured: Aug 26 16:04:27.709156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e HTTP/1.1 Aug 26 16:04:27.709156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 16:04:27.709156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 16:04:27.709156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 16:04:27.709156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 0 Aug 26 16:04:27.709156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 16:04:27.709156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 16:04:27.709156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 16:04:27.709156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 16:04:27.709156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO0-uZaz_yI8Fg49dle3FpYUy1aJ0NnJxpD4O_IzcLsXjBlx-RJAMTxN5SJE7qQ5dMQ_t19b4V47Xy7w3YZjwfMxBPUM9w64mwEA_HXhitBdZDc4m_jadz8TKAx7O7WpinSOa0TLZUo_YeVpTFQpEDv2Sgn55PqSQsUwV_NAHhnYzUs Aug 26 16:04:27.709156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 16:04:27.709156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 16:04:27.709156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 16:04:27.709156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 16:04:27.709156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 16:04:27.709156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 16:04:27.709156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: 8c69c9fb12124d72954b8ab7ad024175 Aug 26 16:04:27.709156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-AttachVolumeTestJSON-1188349192 Aug 26 16:04:27.709156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 16:04:27.709156 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 16:04:27.710801 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/8c69c9fb12124d72954b8ab7ad024175"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/8c69c9fb12124d72954b8ab7ad024175"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/8c69c9fb12124d72954b8ab7ad024175"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_8c69c9fb12124d72954b8ab7ad024175", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:04:27.710801 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-AttachVolumeTestJSON-1188349192 Aug 26 16:04:27.710801 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: 8c69c9fb12124d72954b8ab7ad024175 Aug 26 16:04:27.710801 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1188349192 Aug 26 16:04:27.710801 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-AttachVolumeTestJSON-1188349192-project Aug 26 16:04:27.710801 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 16:04:27.710801 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 16:04:27.710801 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: 7069a9b54a3245b3ab9671730344e6d3 Aug 26 16:04:27.710801 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-AttachVolumeTestJSON-1188349192-project Aug 26 16:04:27.710801 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: > Aug 26 16:04:27.710801 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Instance f0e476ca-b4b7-4537-bfca-2c66b7246c3e could not be found. Aug 26 16:04:27.710801 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'id': 'f0e476ca-b4b7-4537-bfca-2c66b7246c3e'} Aug 26 16:04:27.711720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:04:27.711720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:27.711720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:04:27.711720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:04:27.711720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:04:27.711720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:04:27.711720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:04:27.711720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:04:27.711720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:04:27.711720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:04:27.711720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0e476ca-b4b7-4537-bfca-2c66b7246c3e could not be found. Aug 26 16:04:27.711720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:27.711720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:27.711720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:27.711720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:27.711720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:27.711720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:27.711720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:04:27.711720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:04:27.711720 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:04:27.713155 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:04:27.713155 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:04:27.713155 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:04:27.713155 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:04:27.713155 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:04:27.713155 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:04:27.713155 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:04:27.713155 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0e476ca-b4b7-4537-bfca-2c66b7246c3e could not be found. Aug 26 16:04:27.713155 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:27.713155 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:27.713155 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:27.713155 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:27.713155 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:27.713155 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:27.713155 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:04:27.713155 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:04:27.713155 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0e476ca-b4b7-4537-bfca-2c66b7246c3e could not be found. Aug 26 16:04:27.713155 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:27.714501 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ebeec572-d548-4ad4-bdd0-9ad39166f59a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] Returning 404 to user: Instance f0e476ca-b4b7-4537-bfca-2c66b7246c3e could not be found. {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:04:27.714501 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ebeec572-d548-4ad4-bdd0-9ad39166f59a tempest-AttachVolumeTestJSON-1188349192 tempest-AttachVolumeTestJSON-1188349192-project] 10.222.0.94 "GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e" status: 404 len: 111 microversion: 2.1 time: 0.031901 Aug 26 16:04:27.714501 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 557/1130] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:27 2022] GET /compute/v2.1/servers/f0e476ca-b4b7-4537-bfca-2c66b7246c3e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:04:28.225828 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ea2dd488-2978-4ad8-9b2d-5dbbde6f7e32 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:28.226818 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ea2dd488-2978-4ad8-9b2d-5dbbde6f7e32 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:28.234627 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ea2dd488-2978-4ad8-9b2d-5dbbde6f7e32 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:28.235443 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ea2dd488-2978-4ad8-9b2d-5dbbde6f7e32 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:28.236807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ea2dd488-2978-4ad8-9b2d-5dbbde6f7e32 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:28.237750 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ea2dd488-2978-4ad8-9b2d-5dbbde6f7e32 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:28.238426 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ea2dd488-2978-4ad8-9b2d-5dbbde6f7e32 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:28.239274 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ea2dd488-2978-4ad8-9b2d-5dbbde6f7e32 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:28.463573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-ea2dd488-2978-4ad8-9b2d-5dbbde6f7e32 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:28.475088 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-ea2dd488-2978-4ad8-9b2d-5dbbde6f7e32 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:28.477047 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-ea2dd488-2978-4ad8-9b2d-5dbbde6f7e32 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:28.479139 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ea2dd488-2978-4ad8-9b2d-5dbbde6f7e32 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1732 microversion: 2.20 time: 0.256735 Aug 26 16:04:28.485764 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 558/1131] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:04:28 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1732 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:04:28.602686 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-27c38cf9-1fde-4a4f-b401-e0a5b863a19a tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:28.603739 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-27c38cf9-1fde-4a4f-b401-e0a5b863a19a tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:28.623318 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-27c38cf9-1fde-4a4f-b401-e0a5b863a19a tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:28.629727 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-27c38cf9-1fde-4a4f-b401-e0a5b863a19a tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:28.630490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-27c38cf9-1fde-4a4f-b401-e0a5b863a19a tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:28.631473 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-27c38cf9-1fde-4a4f-b401-e0a5b863a19a tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:28.633170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-27c38cf9-1fde-4a4f-b401-e0a5b863a19a tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:28.635708 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-27c38cf9-1fde-4a4f-b401-e0a5b863a19a tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:28.883557 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-27c38cf9-1fde-4a4f-b401-e0a5b863a19a tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:28.893282 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-27c38cf9-1fde-4a4f-b401-e0a5b863a19a tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1555 microversion: 2.1 time: 0.295483 Aug 26 16:04:28.894503 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 559/1132] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:28 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1555 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:04:28.899125 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-14f7fc2f-d9f7-44c2-8809-f27a51ff9b9e req-67a0880e-a7c2-47af-8bf6-33883c0d9fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d2e527f-8238-448e-bad8-72e6223612f0", "name": "network-vif-deleted", "tag": "9fafeb43-ac51-4d27-a7ea-6b8e26f031a0"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:04:28.908735 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-14f7fc2f-d9f7-44c2-8809-f27a51ff9b9e req-67a0880e-a7c2-47af-8bf6-33883c0d9fa9 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:28.909219 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-14f7fc2f-d9f7-44c2-8809-f27a51ff9b9e req-67a0880e-a7c2-47af-8bf6-33883c0d9fa9 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:28.909659 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-14f7fc2f-d9f7-44c2-8809-f27a51ff9b9e req-67a0880e-a7c2-47af-8bf6-33883c0d9fa9 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:28.918512 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-145292f4-e802-41cd-b094-67405b676cae tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "POST /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.596642 Aug 26 16:04:28.922987 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 574/1133] 10.222.0.94 () {60 vars in 1323 bytes} [Fri Aug 26 16:04:26 2022] POST /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154/os-volume_attachments => generated 194 bytes in 2598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:04:28.936257 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-14f7fc2f-d9f7-44c2-8809-f27a51ff9b9e req-67a0880e-a7c2-47af-8bf6-33883c0d9fa9 service nova] Creating event network-vif-deleted:9fafeb43-ac51-4d27-a7ea-6b8e26f031a0 for instance 6d2e527f-8238-448e-bad8-72e6223612f0 on hv-cinder-85144 Aug 26 16:04:28.948827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-14f7fc2f-d9f7-44c2-8809-f27a51ff9b9e req-67a0880e-a7c2-47af-8bf6-33883c0d9fa9 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052864 Aug 26 16:04:28.949955 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 560/1134] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:04:29.513242 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-2601fc91-6017-40ae-adaa-f0b663c786eb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:29.513242 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-2601fc91-6017-40ae-adaa-f0b663c786eb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:29.519154 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2601fc91-6017-40ae-adaa-f0b663c786eb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:29.520473 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2601fc91-6017-40ae-adaa-f0b663c786eb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:29.521067 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2601fc91-6017-40ae-adaa-f0b663c786eb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:29.521941 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2601fc91-6017-40ae-adaa-f0b663c786eb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:29.522624 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2601fc91-6017-40ae-adaa-f0b663c786eb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:29.523224 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2601fc91-6017-40ae-adaa-f0b663c786eb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:29.689904 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-2601fc91-6017-40ae-adaa-f0b663c786eb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:29.699443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-2601fc91-6017-40ae-adaa-f0b663c786eb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:29.701249 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-2601fc91-6017-40ae-adaa-f0b663c786eb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:29.702875 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-2601fc91-6017-40ae-adaa-f0b663c786eb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1719 microversion: 2.20 time: 0.197301 Aug 26 16:04:29.704334 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 575/1135] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:04:29 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1719 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:04:29.914626 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-a83a83fc-2640-4fc1-bb57-9b735e951cb3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:29.920791 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-a83a83fc-2640-4fc1-bb57-9b735e951cb3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:29.923498 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a83a83fc-2640-4fc1-bb57-9b735e951cb3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:29.923992 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a83a83fc-2640-4fc1-bb57-9b735e951cb3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:29.924430 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a83a83fc-2640-4fc1-bb57-9b735e951cb3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:29.925167 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a83a83fc-2640-4fc1-bb57-9b735e951cb3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:29.925631 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a83a83fc-2640-4fc1-bb57-9b735e951cb3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:29.926116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a83a83fc-2640-4fc1-bb57-9b735e951cb3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:29.966563 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a83a83fc-2640-4fc1-bb57-9b735e951cb3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:29.966563 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a83a83fc-2640-4fc1-bb57-9b735e951cb3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:29.966563 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-a83a83fc-2640-4fc1-bb57-9b735e951cb3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:29.966563 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.objects.instance [None req-a83a83fc-2640-4fc1-bb57-9b735e951cb3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lazy-loading 'fault' on Instance uuid 6d2e527f-8238-448e-bad8-72e6223612f0 {{(pid=128304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:04:30.022696 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-a83a83fc-2640-4fc1-bb57-9b735e951cb3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36d61fd7e97d433e886aaf495f703751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070e0f497888488d863e2f63b87a31ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:30.036663 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-a83a83fc-2640-4fc1-bb57-9b735e951cb3 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 200 len: 1349 microversion: 2.1 time: 0.125576 Aug 26 16:04:30.037929 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 561/1136] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:29 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 1349 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:04:31.060332 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a259697a-7348-442a-9638-0b7123d222e7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:31.060940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a259697a-7348-442a-9638-0b7123d222e7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] [instance: 6d2e527f-8238-448e-bad8-72e6223612f0] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:31.070006 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a259697a-7348-442a-9638-0b7123d222e7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:31.070497 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a259697a-7348-442a-9638-0b7123d222e7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:31.070964 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a259697a-7348-442a-9638-0b7123d222e7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:31.071669 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a259697a-7348-442a-9638-0b7123d222e7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:31.072127 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a259697a-7348-442a-9638-0b7123d222e7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:31.072552 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a259697a-7348-442a-9638-0b7123d222e7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:31.087877 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.wsgi [None req-a259697a-7348-442a-9638-0b7123d222e7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] HTTP exception thrown: Instance 6d2e527f-8238-448e-bad8-72e6223612f0 could not be found. Aug 26 16:04:31.090205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a259697a-7348-442a-9638-0b7123d222e7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Request method failure captured: Aug 26 16:04:31.090205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: request: GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 HTTP/1.1 Aug 26 16:04:31.090205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept: application/json Aug 26 16:04:31.090205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept-Encoding: identity Aug 26 16:04:31.090205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Connection: close Aug 26 16:04:31.090205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Length: 0 Aug 26 16:04:31.090205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Type: application/json Aug 26 16:04:31.090205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Host: 10.222.0.94 Aug 26 16:04:31.090205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Openstack-System-Scope: None Aug 26 16:04:31.090205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: User-Agent: python-urllib3/1.26.11 Aug 26 16:04:31.090205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Auth-Token: gAAAAABjCO5TOY1fuFi4YzZ5kdrr0OUM4ZjpcZQbc2wYRHhIzwKACgvItThnG3GUWRCe6fuyDQjm2zqviKWJy-or21rW5rZfRXuM_5O2ii4hqsjCy9Prg9p0S1Qrq__Hz9fC96b4X3Chh9s2KIdgcA_uRJfKzl7stqNqJBC6tzD5jSeO43jrn3Y Aug 26 16:04:31.090205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Id: None Aug 26 16:04:31.090205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Name: None Aug 26 16:04:31.090205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Identity-Status: Confirmed Aug 26 16:04:31.090205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Is-Admin-Project: True Aug 26 16:04:31.090205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Id: default Aug 26 16:04:31.090205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Name: Default Aug 26 16:04:31.090205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Id: 070e0f497888488d863e2f63b87a31ff Aug 26 16:04:31.090205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Name: tempest-TestMinimumBasicScenario-2098821400 Aug 26 16:04:31.090205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Role: member,reader Aug 26 16:04:31.090205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Roles: member,reader Aug 26 16:04:31.095677 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/070e0f497888488d863e2f63b87a31ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/070e0f497888488d863e2f63b87a31ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/070e0f497888488d863e2f63b87a31ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_070e0f497888488d863e2f63b87a31ff", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:04:31.095677 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant: tempest-TestMinimumBasicScenario-2098821400 Aug 26 16:04:31.095677 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Id: 070e0f497888488d863e2f63b87a31ff Aug 26 16:04:31.095677 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2098821400 Aug 26 16:04:31.095677 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User: tempest-TestMinimumBasicScenario-2098821400-project Aug 26 16:04:31.095677 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Id: default Aug 26 16:04:31.095677 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Name: Default Aug 26 16:04:31.095677 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Id: 36d61fd7e97d433e886aaf495f703751 Aug 26 16:04:31.095677 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Name: tempest-TestMinimumBasicScenario-2098821400-project Aug 26 16:04:31.095677 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: method: > Aug 26 16:04:31.095677 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: exception: Instance 6d2e527f-8238-448e-bad8-72e6223612f0 could not be found. Aug 26 16:04:31.095677 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: action_args: {'id': '6d2e527f-8238-448e-bad8-72e6223612f0'} Aug 26 16:04:31.096580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:04:31.096580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:31.096580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:04:31.096580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:04:31.096580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:04:31.096580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:04:31.096580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:04:31.096580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:04:31.096580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:04:31.096580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:04:31.096580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d2e527f-8238-448e-bad8-72e6223612f0 could not be found. Aug 26 16:04:31.096580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:31.096580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:31.096580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:31.096580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:31.096580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:31.096580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:31.096580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:04:31.096580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:04:31.096580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:04:31.097789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:04:31.097789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:04:31.097789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:04:31.097789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:04:31.097789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:04:31.097789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:04:31.097789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:04:31.097789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d2e527f-8238-448e-bad8-72e6223612f0 could not be found. Aug 26 16:04:31.097789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:31.097789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:31.097789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:31.097789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:31.097789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:31.097789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:31.097789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:04:31.097789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:04:31.097789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d2e527f-8238-448e-bad8-72e6223612f0 could not be found. Aug 26 16:04:31.097789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:31.098897 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a259697a-7348-442a-9638-0b7123d222e7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Returning 404 to user: Instance 6d2e527f-8238-448e-bad8-72e6223612f0 could not be found. {{(pid=128305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:04:31.098897 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a259697a-7348-442a-9638-0b7123d222e7 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0" status: 404 len: 111 microversion: 2.1 time: 0.035632 Aug 26 16:04:31.098897 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 576/1137] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:31 2022] GET /compute/v2.1/servers/6d2e527f-8238-448e-bad8-72e6223612f0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:04:31.106538 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-77f0d3ea-7869-4fbb-8957-049cb8d13b36 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] Calling method '.version_select at 0x7f15d9834790>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:31.214109 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-77f0d3ea-7869-4fbb-8957-049cb8d13b36 tempest-TestMinimumBasicScenario-2098821400 tempest-TestMinimumBasicScenario-2098821400-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1729566069" status: 202 len: 0 microversion: 2.1 time: 0.112905 Aug 26 16:04:31.214627 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 562/1138] 10.222.0.94 () {58 vars in 1272 bytes} [Fri Aug 26 16:04:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1729566069 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 16:04:34.047535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-abde9522-71b2-48a9-a28f-44638ad61465 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:04:34.048059 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-abde9522-71b2-48a9-a28f-44638ad61465 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:34.054742 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-abde9522-71b2-48a9-a28f-44638ad61465 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:34.055410 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-abde9522-71b2-48a9-a28f-44638ad61465 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:34.055857 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-abde9522-71b2-48a9-a28f-44638ad61465 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:34.056574 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-abde9522-71b2-48a9-a28f-44638ad61465 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:34.057029 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-abde9522-71b2-48a9-a28f-44638ad61465 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:34.057456 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-abde9522-71b2-48a9-a28f-44638ad61465 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:34.093833 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-abde9522-71b2-48a9-a28f-44638ad61465 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lazy-loading 'flavor' on Instance uuid b456054b-9e50-43c0-ae5a-8f614cbc102b {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:04:34.514012 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-abde9522-71b2-48a9-a28f-44638ad61465 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "POST /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b/action" status: 202 len: 0 microversion: 2.1 time: 0.470151 Aug 26 16:04:34.514986 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 577/1139] 10.222.0.94 () {60 vars in 1278 bytes} [Fri Aug 26 16:04:34 2022] POST /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 16:04:34.524314 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-22d44c85-9a09-4711-83d9-e2ccd50f84de tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:34.525037 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-22d44c85-9a09-4711-83d9-e2ccd50f84de tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:34.532424 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-22d44c85-9a09-4711-83d9-e2ccd50f84de tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:34.533248 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-22d44c85-9a09-4711-83d9-e2ccd50f84de tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:34.533914 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-22d44c85-9a09-4711-83d9-e2ccd50f84de tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:34.534846 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-22d44c85-9a09-4711-83d9-e2ccd50f84de tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:34.535542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-22d44c85-9a09-4711-83d9-e2ccd50f84de tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:34.536395 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-22d44c85-9a09-4711-83d9-e2ccd50f84de tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:34.815619 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-22d44c85-9a09-4711-83d9-e2ccd50f84de tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:34.824053 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-22d44c85-9a09-4711-83d9-e2ccd50f84de tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1569 microversion: 2.1 time: 0.304707 Aug 26 16:04:34.824670 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 563/1140] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:34 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1569 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:35.847424 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-eadcd146-2e3b-4b1d-b96e-e3ed4fbe41a5 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:35.848246 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-eadcd146-2e3b-4b1d-b96e-e3ed4fbe41a5 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:35.855497 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-eadcd146-2e3b-4b1d-b96e-e3ed4fbe41a5 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:35.856054 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-eadcd146-2e3b-4b1d-b96e-e3ed4fbe41a5 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:35.856551 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-eadcd146-2e3b-4b1d-b96e-e3ed4fbe41a5 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:35.857308 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-eadcd146-2e3b-4b1d-b96e-e3ed4fbe41a5 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:35.857820 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-eadcd146-2e3b-4b1d-b96e-e3ed4fbe41a5 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:35.858875 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-eadcd146-2e3b-4b1d-b96e-e3ed4fbe41a5 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:35.887743 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:04:36.104441 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-eadcd146-2e3b-4b1d-b96e-e3ed4fbe41a5 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:36.112578 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-eadcd146-2e3b-4b1d-b96e-e3ed4fbe41a5 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1569 microversion: 2.1 time: 0.269660 Aug 26 16:04:36.113148 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 578/1141] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:35 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1569 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:37.136137 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-4ff8a74c-5d4f-4b17-8337-7a9f6394bc82 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:37.136866 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-4ff8a74c-5d4f-4b17-8337-7a9f6394bc82 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:37.146080 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ff8a74c-5d4f-4b17-8337-7a9f6394bc82 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:37.146497 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ff8a74c-5d4f-4b17-8337-7a9f6394bc82 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:37.147056 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ff8a74c-5d4f-4b17-8337-7a9f6394bc82 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:37.148403 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ff8a74c-5d4f-4b17-8337-7a9f6394bc82 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:37.148403 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ff8a74c-5d4f-4b17-8337-7a9f6394bc82 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:37.150218 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4ff8a74c-5d4f-4b17-8337-7a9f6394bc82 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:37.386390 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-4ff8a74c-5d4f-4b17-8337-7a9f6394bc82 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:37.395086 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-4ff8a74c-5d4f-4b17-8337-7a9f6394bc82 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1569 microversion: 2.1 time: 0.262888 Aug 26 16:04:37.395669 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 564/1142] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:37 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1569 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:37.741323 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-531d76f6-a8d8-4341-81a6-ecef5e4e37ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:37.742092 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-531d76f6-a8d8-4341-81a6-ecef5e4e37ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:37.750893 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-531d76f6-a8d8-4341-81a6-ecef5e4e37ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:37.751487 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-531d76f6-a8d8-4341-81a6-ecef5e4e37ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:37.759816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-531d76f6-a8d8-4341-81a6-ecef5e4e37ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:37.759816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-531d76f6-a8d8-4341-81a6-ecef5e4e37ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:37.759816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-531d76f6-a8d8-4341-81a6-ecef5e4e37ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:37.759816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-531d76f6-a8d8-4341-81a6-ecef5e4e37ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:37.837697 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-531d76f6-a8d8-4341-81a6-ecef5e4e37ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lazy-loading 'services' on Instance uuid 579627a3-5e3e-40c0-be7a-c333ee8ee154 {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:04:38.144653 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-531d76f6-a8d8-4341-81a6-ecef5e4e37ba tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "DELETE /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154/os-volume_attachments/49677a68-be5c-47e7-8c1d-c2700f63f256" status: 202 len: 0 microversion: 2.1 time: 0.408410 Aug 26 16:04:38.145334 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 579/1143] 10.222.0.94 () {58 vars in 1416 bytes} [Fri Aug 26 16:04:37 2022] DELETE /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154/os-volume_attachments/49677a68-be5c-47e7-8c1d-c2700f63f256 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 16:04:38.153820 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-e2fd30e3-1620-4678-91c8-9d481f3a5529 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:38.156940 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-e2fd30e3-1620-4678-91c8-9d481f3a5529 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:38.163482 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e2fd30e3-1620-4678-91c8-9d481f3a5529 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:38.163964 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e2fd30e3-1620-4678-91c8-9d481f3a5529 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:38.164401 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e2fd30e3-1620-4678-91c8-9d481f3a5529 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:38.165099 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e2fd30e3-1620-4678-91c8-9d481f3a5529 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:38.165556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e2fd30e3-1620-4678-91c8-9d481f3a5529 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:38.165980 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e2fd30e3-1620-4678-91c8-9d481f3a5529 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:38.195830 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-e2fd30e3-1620-4678-91c8-9d481f3a5529 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046067 Aug 26 16:04:38.196385 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 565/1144] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:04:38 2022] GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:04:38.418071 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-95a24890-6177-4ade-b854-685444fb5da3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:38.418942 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-95a24890-6177-4ade-b854-685444fb5da3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:38.426474 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-95a24890-6177-4ade-b854-685444fb5da3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:38.426474 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-95a24890-6177-4ade-b854-685444fb5da3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:38.426950 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-95a24890-6177-4ade-b854-685444fb5da3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:38.427635 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-95a24890-6177-4ade-b854-685444fb5da3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:38.428077 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-95a24890-6177-4ade-b854-685444fb5da3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:38.428493 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-95a24890-6177-4ade-b854-685444fb5da3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:38.673102 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-95a24890-6177-4ade-b854-685444fb5da3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:38.681189 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-95a24890-6177-4ade-b854-685444fb5da3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1569 microversion: 2.1 time: 0.268157 Aug 26 16:04:38.681763 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 580/1145] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:38 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1569 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:39.220252 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-4e482bf8-1f77-41ba-b5c6-1371a924c11d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:39.220252 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-4e482bf8-1f77-41ba-b5c6-1371a924c11d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:39.224018 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4e482bf8-1f77-41ba-b5c6-1371a924c11d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:39.224765 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4e482bf8-1f77-41ba-b5c6-1371a924c11d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:39.225365 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4e482bf8-1f77-41ba-b5c6-1371a924c11d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:39.226241 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4e482bf8-1f77-41ba-b5c6-1371a924c11d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:39.226973 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4e482bf8-1f77-41ba-b5c6-1371a924c11d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:39.227562 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4e482bf8-1f77-41ba-b5c6-1371a924c11d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:39.265859 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-4e482bf8-1f77-41ba-b5c6-1371a924c11d tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059585 Aug 26 16:04:39.267434 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 566/1146] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:04:39 2022] GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:04:39.704475 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-30ccfba8-081d-44dd-87ac-099ed091d4f7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:39.705028 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-30ccfba8-081d-44dd-87ac-099ed091d4f7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:39.712055 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-30ccfba8-081d-44dd-87ac-099ed091d4f7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:39.712768 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-30ccfba8-081d-44dd-87ac-099ed091d4f7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:39.713207 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-30ccfba8-081d-44dd-87ac-099ed091d4f7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:39.713918 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-30ccfba8-081d-44dd-87ac-099ed091d4f7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:39.714412 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-30ccfba8-081d-44dd-87ac-099ed091d4f7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:39.714849 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-30ccfba8-081d-44dd-87ac-099ed091d4f7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:39.894805 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-30ccfba8-081d-44dd-87ac-099ed091d4f7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:39.902527 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-30ccfba8-081d-44dd-87ac-099ed091d4f7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1569 microversion: 2.1 time: 0.203337 Aug 26 16:04:39.903125 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 581/1147] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:39 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1569 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:40.278682 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-5ba4d700-9fa4-43a7-8bf4-834cbe9e7193 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:40.281006 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-5ba4d700-9fa4-43a7-8bf4-834cbe9e7193 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:40.287802 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5ba4d700-9fa4-43a7-8bf4-834cbe9e7193 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:40.288292 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5ba4d700-9fa4-43a7-8bf4-834cbe9e7193 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:40.288760 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5ba4d700-9fa4-43a7-8bf4-834cbe9e7193 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:40.289468 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5ba4d700-9fa4-43a7-8bf4-834cbe9e7193 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:40.289926 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5ba4d700-9fa4-43a7-8bf4-834cbe9e7193 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:40.290356 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5ba4d700-9fa4-43a7-8bf4-834cbe9e7193 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:40.320039 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-5ba4d700-9fa4-43a7-8bf4-834cbe9e7193 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045418 Aug 26 16:04:40.320594 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 567/1148] 10.222.0.94 () {58 vars in 1302 bytes} [Fri Aug 26 16:04:40 2022] GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 16:04:40.387602 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-fafa9962-98cf-4177-af5f-04da3716fd53 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:40.388410 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-fafa9962-98cf-4177-af5f-04da3716fd53 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:40.395723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fafa9962-98cf-4177-af5f-04da3716fd53 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:40.396481 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fafa9962-98cf-4177-af5f-04da3716fd53 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:40.396913 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fafa9962-98cf-4177-af5f-04da3716fd53 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:40.397612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fafa9962-98cf-4177-af5f-04da3716fd53 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:40.398173 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fafa9962-98cf-4177-af5f-04da3716fd53 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:40.398839 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-fafa9962-98cf-4177-af5f-04da3716fd53 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:40.427759 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-fafa9962-98cf-4177-af5f-04da3716fd53 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] Going to try to terminate instance {{(pid=128305) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 16:04:40.769718 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-fafa9962-98cf-4177-af5f-04da3716fd53 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "DELETE /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154" status: 204 len: 0 microversion: 2.1 time: 0.386033 Aug 26 16:04:40.770781 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 582/1149] 10.222.0.94 () {58 vars in 1239 bytes} [Fri Aug 26 16:04:40 2022] DELETE /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 16:04:40.788620 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-b212e487-303e-4221-9ce7-3e188293fce5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:40.789297 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-b212e487-303e-4221-9ce7-3e188293fce5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:40.795482 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b212e487-303e-4221-9ce7-3e188293fce5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:40.795992 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b212e487-303e-4221-9ce7-3e188293fce5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:40.796607 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b212e487-303e-4221-9ce7-3e188293fce5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:40.797312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b212e487-303e-4221-9ce7-3e188293fce5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:40.797764 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b212e487-303e-4221-9ce7-3e188293fce5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:40.798187 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b212e487-303e-4221-9ce7-3e188293fce5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:40.924530 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-46131aeb-68e6-4ed3-b0b5-78d389470356 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:40.925300 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-46131aeb-68e6-4ed3-b0b5-78d389470356 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:40.935590 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-46131aeb-68e6-4ed3-b0b5-78d389470356 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:40.936985 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-46131aeb-68e6-4ed3-b0b5-78d389470356 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:40.937434 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-46131aeb-68e6-4ed3-b0b5-78d389470356 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:40.938156 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-46131aeb-68e6-4ed3-b0b5-78d389470356 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:40.938612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-46131aeb-68e6-4ed3-b0b5-78d389470356 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:40.941358 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-46131aeb-68e6-4ed3-b0b5-78d389470356 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:41.027338 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-b212e487-303e-4221-9ce7-3e188293fce5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:41.040838 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-b212e487-303e-4221-9ce7-3e188293fce5 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154" status: 200 len: 1679 microversion: 2.1 time: 0.265925 Aug 26 16:04:41.041963 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 568/1150] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:40 2022] GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154 => generated 1679 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:41.178182 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-46131aeb-68e6-4ed3-b0b5-78d389470356 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:41.187230 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-46131aeb-68e6-4ed3-b0b5-78d389470356 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1569 microversion: 2.1 time: 0.266165 Aug 26 16:04:41.187935 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 583/1151] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:40 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1569 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:04:42.067305 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-0b59610e-8a5b-437f-a19f-6fcc8fb3fa49 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:42.068882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-0b59610e-8a5b-437f-a19f-6fcc8fb3fa49 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:42.075607 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0b59610e-8a5b-437f-a19f-6fcc8fb3fa49 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:42.076037 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0b59610e-8a5b-437f-a19f-6fcc8fb3fa49 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:42.076475 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0b59610e-8a5b-437f-a19f-6fcc8fb3fa49 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:42.077896 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0b59610e-8a5b-437f-a19f-6fcc8fb3fa49 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:42.078364 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0b59610e-8a5b-437f-a19f-6fcc8fb3fa49 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:42.078997 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0b59610e-8a5b-437f-a19f-6fcc8fb3fa49 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:42.214126 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-1a8320d2-ae44-4461-8782-b8085da22fb9 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:42.215356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-1a8320d2-ae44-4461-8782-b8085da22fb9 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:42.220326 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-0b59610e-8a5b-437f-a19f-6fcc8fb3fa49 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:42.224985 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1a8320d2-ae44-4461-8782-b8085da22fb9 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:42.225844 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1a8320d2-ae44-4461-8782-b8085da22fb9 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:42.227160 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1a8320d2-ae44-4461-8782-b8085da22fb9 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:42.227160 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1a8320d2-ae44-4461-8782-b8085da22fb9 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:42.229877 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1a8320d2-ae44-4461-8782-b8085da22fb9 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:42.229877 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1a8320d2-ae44-4461-8782-b8085da22fb9 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:42.230110 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-0b59610e-8a5b-437f-a19f-6fcc8fb3fa49 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154" status: 200 len: 1679 microversion: 2.1 time: 0.167194 Aug 26 16:04:42.230624 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 569/1152] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:42 2022] GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:42.404274 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-1a8320d2-ae44-4461-8782-b8085da22fb9 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:42.412903 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-1a8320d2-ae44-4461-8782-b8085da22fb9 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1569 microversion: 2.1 time: 0.208010 Aug 26 16:04:42.413476 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 584/1153] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:42 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:43.255933 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-c209e595-4f6e-40d8-ad19-dd593ffd28a2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:43.256721 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-c209e595-4f6e-40d8-ad19-dd593ffd28a2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:43.265753 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c209e595-4f6e-40d8-ad19-dd593ffd28a2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:43.266281 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c209e595-4f6e-40d8-ad19-dd593ffd28a2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:43.266725 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c209e595-4f6e-40d8-ad19-dd593ffd28a2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:43.267466 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c209e595-4f6e-40d8-ad19-dd593ffd28a2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:43.267927 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c209e595-4f6e-40d8-ad19-dd593ffd28a2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:43.268445 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c209e595-4f6e-40d8-ad19-dd593ffd28a2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:43.274059 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=100 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:04:43.434125 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-4064f291-141b-4f0c-ac82-9dbea57f68ce tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:43.434891 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-4064f291-141b-4f0c-ac82-9dbea57f68ce tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:43.442714 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4064f291-141b-4f0c-ac82-9dbea57f68ce tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:43.443415 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4064f291-141b-4f0c-ac82-9dbea57f68ce tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:43.443964 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4064f291-141b-4f0c-ac82-9dbea57f68ce tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:43.444763 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4064f291-141b-4f0c-ac82-9dbea57f68ce tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:43.445456 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4064f291-141b-4f0c-ac82-9dbea57f68ce tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:43.445975 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4064f291-141b-4f0c-ac82-9dbea57f68ce tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:43.629184 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-c209e595-4f6e-40d8-ad19-dd593ffd28a2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:43.637151 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-c209e595-4f6e-40d8-ad19-dd593ffd28a2 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154" status: 200 len: 1679 microversion: 2.1 time: 0.389183 Aug 26 16:04:43.651545 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 570/1154] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:43 2022] GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154 => generated 1679 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:43.726792 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-4064f291-141b-4f0c-ac82-9dbea57f68ce tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:43.734686 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-4064f291-141b-4f0c-ac82-9dbea57f68ce tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1569 microversion: 2.1 time: 0.304409 Aug 26 16:04:43.735327 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 585/1155] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:43 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1569 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:04:43.860812 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-01f213cc-84ae-4842-b15e-1398c3e7a7c5 req-ad29ce3d-0733-4960-aec3-87dfb4a833bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "579627a3-5e3e-40c0-be7a-c333ee8ee154", "name": "network-vif-deleted", "tag": "fb610a76-d6cc-4bcd-be95-56a4a36620ad"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:04:43.886817 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-01f213cc-84ae-4842-b15e-1398c3e7a7c5 req-ad29ce3d-0733-4960-aec3-87dfb4a833bb service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:43.890299 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-01f213cc-84ae-4842-b15e-1398c3e7a7c5 req-ad29ce3d-0733-4960-aec3-87dfb4a833bb service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:43.890755 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-01f213cc-84ae-4842-b15e-1398c3e7a7c5 req-ad29ce3d-0733-4960-aec3-87dfb4a833bb service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:43.905321 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-01f213cc-84ae-4842-b15e-1398c3e7a7c5 req-ad29ce3d-0733-4960-aec3-87dfb4a833bb service nova] Creating event network-vif-deleted:fb610a76-d6cc-4bcd-be95-56a4a36620ad for instance 579627a3-5e3e-40c0-be7a-c333ee8ee154 on hv-cinder-85144 Aug 26 16:04:43.911824 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-01f213cc-84ae-4842-b15e-1398c3e7a7c5 req-ad29ce3d-0733-4960-aec3-87dfb4a833bb service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055716 Aug 26 16:04:43.912745 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 571/1156] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:04:44.659161 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-cbffef0e-28c5-4b0a-9990-3fd8071cf71f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:44.659863 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-cbffef0e-28c5-4b0a-9990-3fd8071cf71f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:44.666796 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cbffef0e-28c5-4b0a-9990-3fd8071cf71f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:44.667124 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cbffef0e-28c5-4b0a-9990-3fd8071cf71f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:44.667585 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cbffef0e-28c5-4b0a-9990-3fd8071cf71f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:44.668787 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cbffef0e-28c5-4b0a-9990-3fd8071cf71f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:44.669548 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cbffef0e-28c5-4b0a-9990-3fd8071cf71f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:44.669982 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cbffef0e-28c5-4b0a-9990-3fd8071cf71f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:44.704728 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cbffef0e-28c5-4b0a-9990-3fd8071cf71f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:44.705213 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cbffef0e-28c5-4b0a-9990-3fd8071cf71f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:44.705715 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cbffef0e-28c5-4b0a-9990-3fd8071cf71f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:44.706253 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-cbffef0e-28c5-4b0a-9990-3fd8071cf71f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lazy-loading 'fault' on Instance uuid 579627a3-5e3e-40c0-be7a-c333ee8ee154 {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:04:44.757220 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-c96debff-bc2a-49b6-93b9-1c2bbe8cdd20 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:44.760106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-c96debff-bc2a-49b6-93b9-1c2bbe8cdd20 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:44.772730 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c96debff-bc2a-49b6-93b9-1c2bbe8cdd20 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:44.773235 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c96debff-bc2a-49b6-93b9-1c2bbe8cdd20 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:44.773692 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c96debff-bc2a-49b6-93b9-1c2bbe8cdd20 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:44.775577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c96debff-bc2a-49b6-93b9-1c2bbe8cdd20 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:44.776067 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c96debff-bc2a-49b6-93b9-1c2bbe8cdd20 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:44.776505 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-c96debff-bc2a-49b6-93b9-1c2bbe8cdd20 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:44.783476 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-cbffef0e-28c5-4b0a-9990-3fd8071cf71f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50041d36b0b430badd6442a2f09f063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95f731096d74a089f4161f5db69280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:44.800215 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-cbffef0e-28c5-4b0a-9990-3fd8071cf71f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154" status: 200 len: 1330 microversion: 2.1 time: 0.143893 Aug 26 16:04:44.800848 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 586/1157] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:44 2022] GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154 => generated 1330 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:44.953747 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-c96debff-bc2a-49b6-93b9-1c2bbe8cdd20 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:44.962512 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-c96debff-bc2a-49b6-93b9-1c2bbe8cdd20 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1569 microversion: 2.1 time: 0.210453 Aug 26 16:04:44.963054 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 572/1158] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:44 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1569 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:04:45.821888 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-bb41ee19-4c53-458e-9cbf-a5209aabc5da tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:45.822615 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-bb41ee19-4c53-458e-9cbf-a5209aabc5da tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:45.828984 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bb41ee19-4c53-458e-9cbf-a5209aabc5da tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:45.829453 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bb41ee19-4c53-458e-9cbf-a5209aabc5da tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:45.829877 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bb41ee19-4c53-458e-9cbf-a5209aabc5da tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:45.830556 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bb41ee19-4c53-458e-9cbf-a5209aabc5da tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:45.831042 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bb41ee19-4c53-458e-9cbf-a5209aabc5da tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:45.831449 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-bb41ee19-4c53-458e-9cbf-a5209aabc5da tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:45.844955 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.wsgi [None req-bb41ee19-4c53-458e-9cbf-a5209aabc5da tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] HTTP exception thrown: Instance 579627a3-5e3e-40c0-be7a-c333ee8ee154 could not be found. Aug 26 16:04:45.846580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-bb41ee19-4c53-458e-9cbf-a5209aabc5da tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Request method failure captured: Aug 26 16:04:45.846580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: request: GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154 HTTP/1.1 Aug 26 16:04:45.846580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept: application/json Aug 26 16:04:45.846580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept-Encoding: identity Aug 26 16:04:45.846580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Connection: close Aug 26 16:04:45.846580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Length: 0 Aug 26 16:04:45.846580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Type: application/json Aug 26 16:04:45.846580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Host: 10.222.0.94 Aug 26 16:04:45.846580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Openstack-System-Scope: None Aug 26 16:04:45.846580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: User-Agent: python-urllib3/1.26.11 Aug 26 16:04:45.846580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Auth-Token: gAAAAABjCO074Vk8Knkkyah_6hQlXk9FvzAhBqPeYMng3gGU-fQ_qYYEN-UvSDuAz2OG4j3gRVAyM63Qk6cGXT3e_LJrqtVIQ2Wh_rCIb7SpxdZF5G6vc_eR0N-2MIzlwTSdPywpn1m7Hkaqaj-3SiKQy1JcwWLQlfAR9RAjH6drO8qCv3BIADQ Aug 26 16:04:45.846580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Id: None Aug 26 16:04:45.846580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Name: None Aug 26 16:04:45.846580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Identity-Status: Confirmed Aug 26 16:04:45.846580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Is-Admin-Project: True Aug 26 16:04:45.846580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Id: default Aug 26 16:04:45.846580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Name: Default Aug 26 16:04:45.846580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Id: d95f731096d74a089f4161f5db69280c Aug 26 16:04:45.846580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Name: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:04:45.846580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Role: member,reader Aug 26 16:04:45.846580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Roles: member,reader Aug 26 16:04:45.848232 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/d95f731096d74a089f4161f5db69280c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/d95f731096d74a089f4161f5db69280c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/d95f731096d74a089f4161f5db69280c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_d95f731096d74a089f4161f5db69280c", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:04:45.848232 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:04:45.848232 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Id: d95f731096d74a089f4161f5db69280c Aug 26 16:04:45.848232 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:04:45.848232 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User: tempest-AttachVolumeNegativeTest-243089979-project Aug 26 16:04:45.848232 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Id: default Aug 26 16:04:45.848232 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Name: Default Aug 26 16:04:45.848232 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Id: b50041d36b0b430badd6442a2f09f063 Aug 26 16:04:45.848232 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Name: tempest-AttachVolumeNegativeTest-243089979-project Aug 26 16:04:45.848232 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: method: > Aug 26 16:04:45.848232 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: exception: Instance 579627a3-5e3e-40c0-be7a-c333ee8ee154 could not be found. Aug 26 16:04:45.848232 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: action_args: {'id': '579627a3-5e3e-40c0-be7a-c333ee8ee154'} Aug 26 16:04:45.849145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:04:45.849145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:45.849145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:04:45.849145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:04:45.849145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:04:45.849145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:04:45.849145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:04:45.849145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:04:45.849145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:04:45.849145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:04:45.849145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 579627a3-5e3e-40c0-be7a-c333ee8ee154 could not be found. Aug 26 16:04:45.849145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:45.849145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:45.849145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:45.849145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:45.849145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:45.849145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:45.849145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:04:45.849145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:04:45.849145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:04:45.850659 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:04:45.850659 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:04:45.850659 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:04:45.850659 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:04:45.850659 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:04:45.850659 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:04:45.850659 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:04:45.850659 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 579627a3-5e3e-40c0-be7a-c333ee8ee154 could not be found. Aug 26 16:04:45.850659 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:45.850659 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:45.850659 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:45.850659 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:45.850659 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:45.850659 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:45.850659 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:04:45.850659 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:04:45.850659 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 579627a3-5e3e-40c0-be7a-c333ee8ee154 could not be found. Aug 26 16:04:45.850659 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:45.852285 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-bb41ee19-4c53-458e-9cbf-a5209aabc5da tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Returning 404 to user: Instance 579627a3-5e3e-40c0-be7a-c333ee8ee154 could not be found. {{(pid=128305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:04:45.852285 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-bb41ee19-4c53-458e-9cbf-a5209aabc5da tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154" status: 404 len: 111 microversion: 2.1 time: 0.030005 Aug 26 16:04:45.852285 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 587/1159] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:45 2022] GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:04:45.856968 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-61588121-5e12-409c-a087-c93aa386451f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '.version_select at 0x7f15d98348b0>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:45.962599 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-61588121-5e12-409c-a087-c93aa386451f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-89516204" status: 202 len: 0 microversion: 2.1 time: 0.109426 Aug 26 16:04:45.963700 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 573/1160] 10.222.0.94 () {58 vars in 1215 bytes} [Fri Aug 26 16:04:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-89516204 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 16:04:45.986016 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-26d90eb1-7840-4905-b128-f3a55c4a8633 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:45.986993 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-26d90eb1-7840-4905-b128-f3a55c4a8633 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:45.994491 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-26d90eb1-7840-4905-b128-f3a55c4a8633 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:45.995448 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-26d90eb1-7840-4905-b128-f3a55c4a8633 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:45.996500 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-26d90eb1-7840-4905-b128-f3a55c4a8633 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:45.997583 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-26d90eb1-7840-4905-b128-f3a55c4a8633 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:45.998202 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-26d90eb1-7840-4905-b128-f3a55c4a8633 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:45.999099 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-26d90eb1-7840-4905-b128-f3a55c4a8633 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:46.208287 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-26d90eb1-7840-4905-b128-f3a55c4a8633 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:46.216985 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-26d90eb1-7840-4905-b128-f3a55c4a8633 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1569 microversion: 2.1 time: 0.236099 Aug 26 16:04:46.217563 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 588/1161] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:45 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1569 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:47.238326 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-42cb8dfa-354c-4285-8b0b-b515a88d517b tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:47.239774 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-42cb8dfa-354c-4285-8b0b-b515a88d517b tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:47.247897 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42cb8dfa-354c-4285-8b0b-b515a88d517b tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:47.279036 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42cb8dfa-354c-4285-8b0b-b515a88d517b tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:47.279036 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42cb8dfa-354c-4285-8b0b-b515a88d517b tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:47.279036 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42cb8dfa-354c-4285-8b0b-b515a88d517b tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:47.279036 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42cb8dfa-354c-4285-8b0b-b515a88d517b tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:47.279454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-42cb8dfa-354c-4285-8b0b-b515a88d517b tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:47.390906 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-42cb8dfa-354c-4285-8b0b-b515a88d517b tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:47.400521 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-42cb8dfa-354c-4285-8b0b-b515a88d517b tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1569 microversion: 2.1 time: 0.166570 Aug 26 16:04:47.408814 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 574/1162] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:47 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:48.423369 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a4984e47-cea4-4c52-bc6f-20ac0ba29621 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:48.424240 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a4984e47-cea4-4c52-bc6f-20ac0ba29621 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:48.430455 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a4984e47-cea4-4c52-bc6f-20ac0ba29621 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:48.430955 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a4984e47-cea4-4c52-bc6f-20ac0ba29621 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:48.431384 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a4984e47-cea4-4c52-bc6f-20ac0ba29621 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:48.432080 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a4984e47-cea4-4c52-bc6f-20ac0ba29621 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:48.432527 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a4984e47-cea4-4c52-bc6f-20ac0ba29621 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:48.432942 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a4984e47-cea4-4c52-bc6f-20ac0ba29621 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:48.606676 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a4984e47-cea4-4c52-bc6f-20ac0ba29621 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:48.615640 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a4984e47-cea4-4c52-bc6f-20ac0ba29621 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1569 microversion: 2.1 time: 0.196723 Aug 26 16:04:48.616402 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 589/1163] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:48 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:48.616567 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f9b493d6-0bfa-477b-a75a-83124643c6cc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:48.616997 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-f9b493d6-0bfa-477b-a75a-83124643c6cc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:48.619747 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=2 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:04:48.629426 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f9b493d6-0bfa-477b-a75a-83124643c6cc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:48.630000 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f9b493d6-0bfa-477b-a75a-83124643c6cc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:48.630547 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f9b493d6-0bfa-477b-a75a-83124643c6cc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:48.631301 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f9b493d6-0bfa-477b-a75a-83124643c6cc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:48.631784 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f9b493d6-0bfa-477b-a75a-83124643c6cc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:48.632285 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f9b493d6-0bfa-477b-a75a-83124643c6cc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:48.658779 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-f9b493d6-0bfa-477b-a75a-83124643c6cc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] HTTP exception thrown: Instance 579627a3-5e3e-40c0-be7a-c333ee8ee154 could not be found. Aug 26 16:04:48.658779 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f9b493d6-0bfa-477b-a75a-83124643c6cc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Request method failure captured: Aug 26 16:04:48.658779 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: DELETE /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154 HTTP/1.1 Aug 26 16:04:48.658779 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 16:04:48.658779 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 16:04:48.658779 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 16:04:48.658779 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 0 Aug 26 16:04:48.658779 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 16:04:48.658779 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 16:04:48.658779 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 16:04:48.658779 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 16:04:48.658779 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO074Vk8Knkkyah_6hQlXk9FvzAhBqPeYMng3gGU-fQ_qYYEN-UvSDuAz2OG4j3gRVAyM63Qk6cGXT3e_LJrqtVIQ2Wh_rCIb7SpxdZF5G6vc_eR0N-2MIzlwTSdPywpn1m7Hkaqaj-3SiKQy1JcwWLQlfAR9RAjH6drO8qCv3BIADQ Aug 26 16:04:48.658779 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 16:04:48.658779 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 16:04:48.658779 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 16:04:48.658779 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 16:04:48.658779 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 16:04:48.658779 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 16:04:48.658779 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: d95f731096d74a089f4161f5db69280c Aug 26 16:04:48.658779 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:04:48.658779 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 16:04:48.658779 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 16:04:48.660421 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/d95f731096d74a089f4161f5db69280c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/d95f731096d74a089f4161f5db69280c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/d95f731096d74a089f4161f5db69280c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_d95f731096d74a089f4161f5db69280c", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:04:48.660421 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:04:48.660421 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: d95f731096d74a089f4161f5db69280c Aug 26 16:04:48.660421 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:04:48.660421 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-AttachVolumeNegativeTest-243089979-project Aug 26 16:04:48.660421 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 16:04:48.660421 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 16:04:48.660421 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: b50041d36b0b430badd6442a2f09f063 Aug 26 16:04:48.660421 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-AttachVolumeNegativeTest-243089979-project Aug 26 16:04:48.660421 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: > Aug 26 16:04:48.660421 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Instance 579627a3-5e3e-40c0-be7a-c333ee8ee154 could not be found. Aug 26 16:04:48.660421 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'id': '579627a3-5e3e-40c0-be7a-c333ee8ee154'} Aug 26 16:04:48.661269 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:04:48.661269 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:48.661269 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:04:48.661269 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:04:48.661269 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:04:48.661269 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:04:48.661269 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:04:48.661269 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:04:48.661269 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:04:48.661269 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:04:48.661269 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 579627a3-5e3e-40c0-be7a-c333ee8ee154 could not be found. Aug 26 16:04:48.661269 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:48.661269 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:48.661269 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:48.661269 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:48.661269 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:48.661269 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:48.661269 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:04:48.661269 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:04:48.661269 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:04:48.662577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:04:48.662577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 16:04:48.662577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 16:04:48.662577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 16:04:48.662577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 16:04:48.662577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:04:48.662577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:04:48.662577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:04:48.662577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:04:48.662577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 579627a3-5e3e-40c0-be7a-c333ee8ee154 could not be found. Aug 26 16:04:48.662577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:48.662577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:48.662577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:48.662577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:48.662577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:48.662577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:48.662577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:04:48.662577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:04:48.662577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 579627a3-5e3e-40c0-be7a-c333ee8ee154 could not be found. Aug 26 16:04:48.662577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:48.664037 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f9b493d6-0bfa-477b-a75a-83124643c6cc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Returning 404 to user: Instance 579627a3-5e3e-40c0-be7a-c333ee8ee154 could not be found. {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:04:48.664037 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-f9b493d6-0bfa-477b-a75a-83124643c6cc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "DELETE /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154" status: 404 len: 111 microversion: 2.1 time: 0.041662 Aug 26 16:04:48.664037 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 575/1164] 10.222.0.94 () {58 vars in 1239 bytes} [Fri Aug 26 16:04:48 2022] DELETE /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 16:04:48.665907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a62330fd-d1c9-44b6-908d-3d02d826ba23 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:48.666601 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a62330fd-d1c9-44b6-908d-3d02d826ba23 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 579627a3-5e3e-40c0-be7a-c333ee8ee154] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:48.673730 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a62330fd-d1c9-44b6-908d-3d02d826ba23 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:48.674219 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a62330fd-d1c9-44b6-908d-3d02d826ba23 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:48.674652 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a62330fd-d1c9-44b6-908d-3d02d826ba23 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:48.675411 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a62330fd-d1c9-44b6-908d-3d02d826ba23 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:48.675861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a62330fd-d1c9-44b6-908d-3d02d826ba23 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:48.676284 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a62330fd-d1c9-44b6-908d-3d02d826ba23 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:48.692443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.wsgi [None req-a62330fd-d1c9-44b6-908d-3d02d826ba23 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] HTTP exception thrown: Instance 579627a3-5e3e-40c0-be7a-c333ee8ee154 could not be found. Aug 26 16:04:48.694067 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a62330fd-d1c9-44b6-908d-3d02d826ba23 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Request method failure captured: Aug 26 16:04:48.694067 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: request: GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154 HTTP/1.1 Aug 26 16:04:48.694067 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept: application/json Aug 26 16:04:48.694067 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept-Encoding: identity Aug 26 16:04:48.694067 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Connection: close Aug 26 16:04:48.694067 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Length: 0 Aug 26 16:04:48.694067 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Type: application/json Aug 26 16:04:48.694067 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Host: 10.222.0.94 Aug 26 16:04:48.694067 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Openstack-System-Scope: None Aug 26 16:04:48.694067 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: User-Agent: python-urllib3/1.26.11 Aug 26 16:04:48.694067 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Auth-Token: gAAAAABjCO074Vk8Knkkyah_6hQlXk9FvzAhBqPeYMng3gGU-fQ_qYYEN-UvSDuAz2OG4j3gRVAyM63Qk6cGXT3e_LJrqtVIQ2Wh_rCIb7SpxdZF5G6vc_eR0N-2MIzlwTSdPywpn1m7Hkaqaj-3SiKQy1JcwWLQlfAR9RAjH6drO8qCv3BIADQ Aug 26 16:04:48.694067 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Id: None Aug 26 16:04:48.694067 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Name: None Aug 26 16:04:48.694067 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Identity-Status: Confirmed Aug 26 16:04:48.694067 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Is-Admin-Project: True Aug 26 16:04:48.694067 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Id: default Aug 26 16:04:48.694067 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Name: Default Aug 26 16:04:48.694067 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Id: d95f731096d74a089f4161f5db69280c Aug 26 16:04:48.694067 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Name: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:04:48.694067 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Role: member,reader Aug 26 16:04:48.694067 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Roles: member,reader Aug 26 16:04:48.695751 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/d95f731096d74a089f4161f5db69280c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/d95f731096d74a089f4161f5db69280c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/d95f731096d74a089f4161f5db69280c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_d95f731096d74a089f4161f5db69280c", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:04:48.695751 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:04:48.695751 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Id: d95f731096d74a089f4161f5db69280c Aug 26 16:04:48.695751 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:04:48.695751 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User: tempest-AttachVolumeNegativeTest-243089979-project Aug 26 16:04:48.695751 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Id: default Aug 26 16:04:48.695751 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Name: Default Aug 26 16:04:48.695751 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Id: b50041d36b0b430badd6442a2f09f063 Aug 26 16:04:48.695751 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Name: tempest-AttachVolumeNegativeTest-243089979-project Aug 26 16:04:48.695751 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: method: > Aug 26 16:04:48.695751 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: exception: Instance 579627a3-5e3e-40c0-be7a-c333ee8ee154 could not be found. Aug 26 16:04:48.695751 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: action_args: {'id': '579627a3-5e3e-40c0-be7a-c333ee8ee154'} Aug 26 16:04:48.699394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:04:48.699394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:48.699394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:04:48.699394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:04:48.699394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:04:48.699394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:04:48.699394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:04:48.699394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:04:48.699394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:04:48.699394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:04:48.699394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 579627a3-5e3e-40c0-be7a-c333ee8ee154 could not be found. Aug 26 16:04:48.699394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:48.699394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:48.699394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:48.699394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:48.699394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:48.699394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:48.699394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:04:48.699394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:04:48.699394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:04:48.700741 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:04:48.700741 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:04:48.700741 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:04:48.700741 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:04:48.700741 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:04:48.700741 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:04:48.700741 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:04:48.700741 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 579627a3-5e3e-40c0-be7a-c333ee8ee154 could not be found. Aug 26 16:04:48.700741 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:48.700741 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:48.700741 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:48.700741 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:48.700741 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:48.700741 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:48.700741 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:04:48.700741 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:04:48.700741 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 579627a3-5e3e-40c0-be7a-c333ee8ee154 could not be found. Aug 26 16:04:48.700741 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:48.702087 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a62330fd-d1c9-44b6-908d-3d02d826ba23 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Returning 404 to user: Instance 579627a3-5e3e-40c0-be7a-c333ee8ee154 could not be found. {{(pid=128305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:04:48.702087 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a62330fd-d1c9-44b6-908d-3d02d826ba23 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154" status: 404 len: 111 microversion: 2.1 time: 0.033848 Aug 26 16:04:48.702087 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 590/1165] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:48 2022] GET /compute/v2.1/servers/579627a3-5e3e-40c0-be7a-c333ee8ee154 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:04:49.637918 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-161b68f0-ad00-42aa-921b-a0ee766c8405 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:49.638538 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-161b68f0-ad00-42aa-921b-a0ee766c8405 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:49.645957 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-161b68f0-ad00-42aa-921b-a0ee766c8405 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:49.646780 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-161b68f0-ad00-42aa-921b-a0ee766c8405 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:49.647243 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-161b68f0-ad00-42aa-921b-a0ee766c8405 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:49.648117 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-161b68f0-ad00-42aa-921b-a0ee766c8405 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:49.648572 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-161b68f0-ad00-42aa-921b-a0ee766c8405 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:49.648995 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-161b68f0-ad00-42aa-921b-a0ee766c8405 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:49.830740 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-161b68f0-ad00-42aa-921b-a0ee766c8405 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:49.862896 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-161b68f0-ad00-42aa-921b-a0ee766c8405 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1570 microversion: 2.1 time: 0.229416 Aug 26 16:04:49.863552 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 576/1166] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:49 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1570 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:04:49.884005 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-2494b73b-fcc5-4375-afca-2223f61633cf tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:04:49.884598 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-2494b73b-fcc5-4375-afca-2223f61633cf tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:49.901643 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2494b73b-fcc5-4375-afca-2223f61633cf tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:49.901643 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2494b73b-fcc5-4375-afca-2223f61633cf tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:49.901643 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2494b73b-fcc5-4375-afca-2223f61633cf tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:49.901643 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2494b73b-fcc5-4375-afca-2223f61633cf tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:49.902051 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2494b73b-fcc5-4375-afca-2223f61633cf tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:49.902051 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2494b73b-fcc5-4375-afca-2223f61633cf tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:49.925089 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-2494b73b-fcc5-4375-afca-2223f61633cf tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128305) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 26 16:04:50.121965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-598c4ec3-24db-4e0d-af3e-d8ceb2b0886f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:50.122272 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-598c4ec3-24db-4e0d-af3e-d8ceb2b0886f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:50.129675 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-598c4ec3-24db-4e0d-af3e-d8ceb2b0886f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:50.130558 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-598c4ec3-24db-4e0d-af3e-d8ceb2b0886f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:50.131107 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-598c4ec3-24db-4e0d-af3e-d8ceb2b0886f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:50.131899 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-598c4ec3-24db-4e0d-af3e-d8ceb2b0886f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:50.132439 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-598c4ec3-24db-4e0d-af3e-d8ceb2b0886f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:50.132935 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-598c4ec3-24db-4e0d-af3e-d8ceb2b0886f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:50.149443 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-598c4ec3-24db-4e0d-af3e-d8ceb2b0886f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] HTTP exception thrown: Instance f241a343-9b6e-471f-9a18-964d506fe4f3 could not be found. Aug 26 16:04:50.151170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-598c4ec3-24db-4e0d-af3e-d8ceb2b0886f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Request method failure captured: Aug 26 16:04:50.151170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: DELETE /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 HTTP/1.1 Aug 26 16:04:50.151170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 16:04:50.151170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 16:04:50.151170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 16:04:50.151170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 0 Aug 26 16:04:50.151170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 16:04:50.151170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 16:04:50.151170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 16:04:50.151170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 16:04:50.151170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO074Vk8Knkkyah_6hQlXk9FvzAhBqPeYMng3gGU-fQ_qYYEN-UvSDuAz2OG4j3gRVAyM63Qk6cGXT3e_LJrqtVIQ2Wh_rCIb7SpxdZF5G6vc_eR0N-2MIzlwTSdPywpn1m7Hkaqaj-3SiKQy1JcwWLQlfAR9RAjH6drO8qCv3BIADQ Aug 26 16:04:50.151170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 16:04:50.151170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 16:04:50.151170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 16:04:50.151170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 16:04:50.151170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 16:04:50.151170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 16:04:50.151170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: d95f731096d74a089f4161f5db69280c Aug 26 16:04:50.151170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:04:50.151170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 16:04:50.151170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 16:04:50.152711 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/d95f731096d74a089f4161f5db69280c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/d95f731096d74a089f4161f5db69280c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/d95f731096d74a089f4161f5db69280c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_d95f731096d74a089f4161f5db69280c", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:04:50.152711 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:04:50.152711 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: d95f731096d74a089f4161f5db69280c Aug 26 16:04:50.152711 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:04:50.152711 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-AttachVolumeNegativeTest-243089979-project Aug 26 16:04:50.152711 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 16:04:50.152711 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 16:04:50.152711 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: b50041d36b0b430badd6442a2f09f063 Aug 26 16:04:50.152711 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-AttachVolumeNegativeTest-243089979-project Aug 26 16:04:50.152711 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: > Aug 26 16:04:50.152711 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Instance f241a343-9b6e-471f-9a18-964d506fe4f3 could not be found. Aug 26 16:04:50.152711 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'id': 'f241a343-9b6e-471f-9a18-964d506fe4f3'} Aug 26 16:04:50.153542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:04:50.153542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:50.153542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:04:50.153542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:04:50.153542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:04:50.153542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:04:50.153542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:04:50.153542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:04:50.153542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:04:50.153542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:04:50.153542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f241a343-9b6e-471f-9a18-964d506fe4f3 could not be found. Aug 26 16:04:50.153542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:50.153542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:50.153542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:50.153542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:50.153542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:50.153542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:50.153542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:04:50.153542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:04:50.153542 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:04:50.155041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:04:50.155041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 16:04:50.155041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 16:04:50.155041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 16:04:50.155041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 16:04:50.155041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:04:50.155041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:04:50.155041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:04:50.155041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:04:50.155041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f241a343-9b6e-471f-9a18-964d506fe4f3 could not be found. Aug 26 16:04:50.155041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:50.155041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:50.155041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:50.155041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:50.155041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:50.155041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:50.155041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:04:50.155041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:04:50.155041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f241a343-9b6e-471f-9a18-964d506fe4f3 could not be found. Aug 26 16:04:50.155041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:50.157941 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-598c4ec3-24db-4e0d-af3e-d8ceb2b0886f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Returning 404 to user: Instance f241a343-9b6e-471f-9a18-964d506fe4f3 could not be found. {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:04:50.159071 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-598c4ec3-24db-4e0d-af3e-d8ceb2b0886f tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "DELETE /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 404 len: 111 microversion: 2.1 time: 0.042085 Aug 26 16:04:50.163131 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 577/1167] 10.222.0.94 () {58 vars in 1239 bytes} [Fri Aug 26 16:04:50 2022] DELETE /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 16:04:50.175977 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f1ba7a1b-bdec-4195-a484-8efa1cd46f23 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:50.177692 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-f1ba7a1b-bdec-4195-a484-8efa1cd46f23 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: f241a343-9b6e-471f-9a18-964d506fe4f3] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:50.196793 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f1ba7a1b-bdec-4195-a484-8efa1cd46f23 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:50.199394 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f1ba7a1b-bdec-4195-a484-8efa1cd46f23 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:50.200056 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f1ba7a1b-bdec-4195-a484-8efa1cd46f23 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:50.200980 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f1ba7a1b-bdec-4195-a484-8efa1cd46f23 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:50.201647 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f1ba7a1b-bdec-4195-a484-8efa1cd46f23 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:50.202677 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f1ba7a1b-bdec-4195-a484-8efa1cd46f23 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:50.219288 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-f1ba7a1b-bdec-4195-a484-8efa1cd46f23 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] HTTP exception thrown: Instance f241a343-9b6e-471f-9a18-964d506fe4f3 could not be found. Aug 26 16:04:50.220901 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f1ba7a1b-bdec-4195-a484-8efa1cd46f23 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Request method failure captured: Aug 26 16:04:50.220901 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 HTTP/1.1 Aug 26 16:04:50.220901 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 16:04:50.220901 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 16:04:50.220901 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 16:04:50.220901 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 0 Aug 26 16:04:50.220901 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 16:04:50.220901 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 16:04:50.220901 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 16:04:50.220901 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 16:04:50.220901 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO074Vk8Knkkyah_6hQlXk9FvzAhBqPeYMng3gGU-fQ_qYYEN-UvSDuAz2OG4j3gRVAyM63Qk6cGXT3e_LJrqtVIQ2Wh_rCIb7SpxdZF5G6vc_eR0N-2MIzlwTSdPywpn1m7Hkaqaj-3SiKQy1JcwWLQlfAR9RAjH6drO8qCv3BIADQ Aug 26 16:04:50.220901 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 16:04:50.220901 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 16:04:50.220901 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 16:04:50.220901 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 16:04:50.220901 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 16:04:50.220901 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 16:04:50.220901 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: d95f731096d74a089f4161f5db69280c Aug 26 16:04:50.220901 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:04:50.220901 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 16:04:50.220901 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 16:04:50.222255 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/d95f731096d74a089f4161f5db69280c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/d95f731096d74a089f4161f5db69280c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/d95f731096d74a089f4161f5db69280c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_d95f731096d74a089f4161f5db69280c", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:04:50.222255 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:04:50.222255 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: d95f731096d74a089f4161f5db69280c Aug 26 16:04:50.222255 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:04:50.222255 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-AttachVolumeNegativeTest-243089979-project Aug 26 16:04:50.222255 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 16:04:50.222255 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 16:04:50.222255 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: b50041d36b0b430badd6442a2f09f063 Aug 26 16:04:50.222255 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-AttachVolumeNegativeTest-243089979-project Aug 26 16:04:50.222255 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: > Aug 26 16:04:50.222255 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Instance f241a343-9b6e-471f-9a18-964d506fe4f3 could not be found. Aug 26 16:04:50.222255 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'id': 'f241a343-9b6e-471f-9a18-964d506fe4f3'} Aug 26 16:04:50.223106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:04:50.223106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:50.223106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:04:50.223106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:04:50.223106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:04:50.223106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:04:50.223106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:04:50.223106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:04:50.223106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:04:50.223106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:04:50.223106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f241a343-9b6e-471f-9a18-964d506fe4f3 could not be found. Aug 26 16:04:50.223106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:50.223106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:50.223106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:50.223106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:50.223106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:50.223106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:50.223106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:04:50.223106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:04:50.223106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:04:50.224530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:04:50.224530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:04:50.224530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:04:50.224530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:04:50.224530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:04:50.224530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:04:50.224530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:04:50.224530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f241a343-9b6e-471f-9a18-964d506fe4f3 could not be found. Aug 26 16:04:50.224530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:50.224530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:50.224530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:50.224530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:50.224530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:50.224530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:50.224530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:04:50.224530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:04:50.224530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f241a343-9b6e-471f-9a18-964d506fe4f3 could not be found. Aug 26 16:04:50.224530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:50.225837 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f1ba7a1b-bdec-4195-a484-8efa1cd46f23 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Returning 404 to user: Instance f241a343-9b6e-471f-9a18-964d506fe4f3 could not be found. {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:04:50.225837 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-f1ba7a1b-bdec-4195-a484-8efa1cd46f23 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3" status: 404 len: 111 microversion: 2.1 time: 0.052549 Aug 26 16:04:50.225837 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 578/1168] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:50 2022] GET /compute/v2.1/servers/f241a343-9b6e-471f-9a18-964d506fe4f3 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:04:50.236057 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ba626f03-8ea1-45de-ae16-8b9b36c478d7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:50.236057 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ba626f03-8ea1-45de-ae16-8b9b36c478d7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:50.240977 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba626f03-8ea1-45de-ae16-8b9b36c478d7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:50.241459 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba626f03-8ea1-45de-ae16-8b9b36c478d7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:50.241910 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba626f03-8ea1-45de-ae16-8b9b36c478d7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:50.243199 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba626f03-8ea1-45de-ae16-8b9b36c478d7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:50.243663 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba626f03-8ea1-45de-ae16-8b9b36c478d7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:50.244089 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ba626f03-8ea1-45de-ae16-8b9b36c478d7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:50.266141 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-ba626f03-8ea1-45de-ae16-8b9b36c478d7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] HTTP exception thrown: Instance ae11b5f9-e68f-4300-82b2-65e2acc9b282 could not be found. Aug 26 16:04:50.267342 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ba626f03-8ea1-45de-ae16-8b9b36c478d7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Request method failure captured: Aug 26 16:04:50.267342 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: DELETE /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 HTTP/1.1 Aug 26 16:04:50.267342 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 16:04:50.267342 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 16:04:50.267342 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 16:04:50.267342 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 0 Aug 26 16:04:50.267342 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 16:04:50.267342 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 16:04:50.267342 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 16:04:50.267342 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 16:04:50.267342 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO074Vk8Knkkyah_6hQlXk9FvzAhBqPeYMng3gGU-fQ_qYYEN-UvSDuAz2OG4j3gRVAyM63Qk6cGXT3e_LJrqtVIQ2Wh_rCIb7SpxdZF5G6vc_eR0N-2MIzlwTSdPywpn1m7Hkaqaj-3SiKQy1JcwWLQlfAR9RAjH6drO8qCv3BIADQ Aug 26 16:04:50.267342 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 16:04:50.267342 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 16:04:50.267342 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 16:04:50.267342 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 16:04:50.267342 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 16:04:50.267342 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 16:04:50.267342 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: d95f731096d74a089f4161f5db69280c Aug 26 16:04:50.267342 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:04:50.267342 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 16:04:50.267342 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 16:04:50.268769 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/d95f731096d74a089f4161f5db69280c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/d95f731096d74a089f4161f5db69280c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/d95f731096d74a089f4161f5db69280c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_d95f731096d74a089f4161f5db69280c", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:04:50.268769 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:04:50.268769 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: d95f731096d74a089f4161f5db69280c Aug 26 16:04:50.268769 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:04:50.268769 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-AttachVolumeNegativeTest-243089979-project Aug 26 16:04:50.268769 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 16:04:50.268769 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 16:04:50.268769 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: b50041d36b0b430badd6442a2f09f063 Aug 26 16:04:50.268769 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-AttachVolumeNegativeTest-243089979-project Aug 26 16:04:50.268769 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: > Aug 26 16:04:50.268769 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Instance ae11b5f9-e68f-4300-82b2-65e2acc9b282 could not be found. Aug 26 16:04:50.268769 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'id': 'ae11b5f9-e68f-4300-82b2-65e2acc9b282'} Aug 26 16:04:50.269761 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:04:50.269761 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:50.269761 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:04:50.269761 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:04:50.269761 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:04:50.269761 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:04:50.269761 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:04:50.269761 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:04:50.269761 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:04:50.269761 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:04:50.269761 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae11b5f9-e68f-4300-82b2-65e2acc9b282 could not be found. Aug 26 16:04:50.269761 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:50.269761 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:50.269761 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:50.269761 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:50.269761 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:50.269761 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:50.269761 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:04:50.269761 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:04:50.269761 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:04:50.271605 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:04:50.271605 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 16:04:50.271605 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 16:04:50.271605 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 16:04:50.271605 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 16:04:50.271605 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:04:50.271605 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:04:50.271605 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:04:50.271605 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:04:50.271605 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae11b5f9-e68f-4300-82b2-65e2acc9b282 could not be found. Aug 26 16:04:50.271605 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:50.271605 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:50.271605 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:50.271605 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:50.271605 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:50.271605 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:50.271605 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:04:50.271605 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:04:50.271605 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae11b5f9-e68f-4300-82b2-65e2acc9b282 could not be found. Aug 26 16:04:50.271605 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:50.274865 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ba626f03-8ea1-45de-ae16-8b9b36c478d7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Returning 404 to user: Instance ae11b5f9-e68f-4300-82b2-65e2acc9b282 could not be found. {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:04:50.274865 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ba626f03-8ea1-45de-ae16-8b9b36c478d7 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "DELETE /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 404 len: 111 microversion: 2.1 time: 0.039959 Aug 26 16:04:50.274865 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 579/1169] 10.222.0.94 () {58 vars in 1239 bytes} [Fri Aug 26 16:04:50 2022] DELETE /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:04:50.275142 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-2494b73b-fcc5-4375-afca-2223f61633cf tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "POST /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b/action" status: 202 len: 0 microversion: 2.1 time: 0.393462 Aug 26 16:04:50.275142 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 591/1170] 10.222.0.94 () {60 vars in 1278 bytes} [Fri Aug 26 16:04:49 2022] POST /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 16:04:50.282940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-c9a1b3b9-8269-47d8-ab84-ac7f4828fed8 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:50.283930 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-c9a1b3b9-8269-47d8-ab84-ac7f4828fed8 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:50.285934 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f81bb00e-ef68-4c67-97ec-cf0d6fcbd4cc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:50.286563 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-f81bb00e-ef68-4c67-97ec-cf0d6fcbd4cc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: ae11b5f9-e68f-4300-82b2-65e2acc9b282] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:50.292015 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c9a1b3b9-8269-47d8-ab84-ac7f4828fed8 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:50.292929 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c9a1b3b9-8269-47d8-ab84-ac7f4828fed8 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:50.293631 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c9a1b3b9-8269-47d8-ab84-ac7f4828fed8 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:50.294529 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c9a1b3b9-8269-47d8-ab84-ac7f4828fed8 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:50.295757 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c9a1b3b9-8269-47d8-ab84-ac7f4828fed8 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:50.296452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c9a1b3b9-8269-47d8-ab84-ac7f4828fed8 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:50.302271 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f81bb00e-ef68-4c67-97ec-cf0d6fcbd4cc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:50.305109 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f81bb00e-ef68-4c67-97ec-cf0d6fcbd4cc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:50.311494 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f81bb00e-ef68-4c67-97ec-cf0d6fcbd4cc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:50.311494 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f81bb00e-ef68-4c67-97ec-cf0d6fcbd4cc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:50.311494 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f81bb00e-ef68-4c67-97ec-cf0d6fcbd4cc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:50.311494 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f81bb00e-ef68-4c67-97ec-cf0d6fcbd4cc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:50.347537 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-f81bb00e-ef68-4c67-97ec-cf0d6fcbd4cc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] HTTP exception thrown: Instance ae11b5f9-e68f-4300-82b2-65e2acc9b282 could not be found. Aug 26 16:04:50.351413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f81bb00e-ef68-4c67-97ec-cf0d6fcbd4cc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Request method failure captured: Aug 26 16:04:50.351413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 HTTP/1.1 Aug 26 16:04:50.351413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 16:04:50.351413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 16:04:50.351413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 16:04:50.351413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 0 Aug 26 16:04:50.351413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 16:04:50.351413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 16:04:50.351413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 16:04:50.351413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 16:04:50.351413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO074Vk8Knkkyah_6hQlXk9FvzAhBqPeYMng3gGU-fQ_qYYEN-UvSDuAz2OG4j3gRVAyM63Qk6cGXT3e_LJrqtVIQ2Wh_rCIb7SpxdZF5G6vc_eR0N-2MIzlwTSdPywpn1m7Hkaqaj-3SiKQy1JcwWLQlfAR9RAjH6drO8qCv3BIADQ Aug 26 16:04:50.351413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 16:04:50.351413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 16:04:50.351413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 16:04:50.351413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 16:04:50.351413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 16:04:50.351413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 16:04:50.351413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: d95f731096d74a089f4161f5db69280c Aug 26 16:04:50.351413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:04:50.351413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 16:04:50.351413 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 16:04:50.353034 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/d95f731096d74a089f4161f5db69280c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/d95f731096d74a089f4161f5db69280c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/d95f731096d74a089f4161f5db69280c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_d95f731096d74a089f4161f5db69280c", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:04:50.353034 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:04:50.353034 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: d95f731096d74a089f4161f5db69280c Aug 26 16:04:50.353034 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:04:50.353034 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-AttachVolumeNegativeTest-243089979-project Aug 26 16:04:50.353034 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 16:04:50.353034 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 16:04:50.353034 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: b50041d36b0b430badd6442a2f09f063 Aug 26 16:04:50.353034 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-AttachVolumeNegativeTest-243089979-project Aug 26 16:04:50.353034 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: > Aug 26 16:04:50.353034 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Instance ae11b5f9-e68f-4300-82b2-65e2acc9b282 could not be found. Aug 26 16:04:50.353034 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'id': 'ae11b5f9-e68f-4300-82b2-65e2acc9b282'} Aug 26 16:04:50.353919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:04:50.353919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:50.353919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:04:50.353919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:04:50.353919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:04:50.353919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:04:50.353919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:04:50.353919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:04:50.353919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:04:50.353919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:04:50.353919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae11b5f9-e68f-4300-82b2-65e2acc9b282 could not be found. Aug 26 16:04:50.353919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:50.353919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:50.353919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:50.353919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:50.353919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:50.353919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:50.353919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:04:50.353919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:04:50.353919 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:04:50.356082 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:04:50.356082 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:04:50.356082 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:04:50.356082 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:04:50.356082 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:04:50.356082 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:04:50.356082 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:04:50.356082 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae11b5f9-e68f-4300-82b2-65e2acc9b282 could not be found. Aug 26 16:04:50.356082 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:50.356082 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:50.356082 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:50.356082 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:50.356082 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:50.356082 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:50.356082 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:04:50.356082 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:04:50.356082 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae11b5f9-e68f-4300-82b2-65e2acc9b282 could not be found. Aug 26 16:04:50.356082 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:50.358147 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f81bb00e-ef68-4c67-97ec-cf0d6fcbd4cc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Returning 404 to user: Instance ae11b5f9-e68f-4300-82b2-65e2acc9b282 could not be found. {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:04:50.358147 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-f81bb00e-ef68-4c67-97ec-cf0d6fcbd4cc tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282" status: 404 len: 111 microversion: 2.1 time: 0.075133 Aug 26 16:04:50.359908 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 580/1171] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:50 2022] GET /compute/v2.1/servers/ae11b5f9-e68f-4300-82b2-65e2acc9b282 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:04:50.551523 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-c9a1b3b9-8269-47d8-ab84-ac7f4828fed8 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:50.569197 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:04:50.569197 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-c9a1b3b9-8269-47d8-ab84-ac7f4828fed8 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1518 microversion: 2.1 time: 0.284451 Aug 26 16:04:50.571574 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 592/1172] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:50 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1518 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:50.572996 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-51d49782-a775-4b10-950d-79c8954b31a8 req-8e59f25d-0519-456d-bc82-ca2cd4d03e7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b456054b-9e50-43c0-ae5a-8f614cbc102b", "name": "network-vif-unplugged", "status": "completed", "tag": "7450399c-70d1-4b9d-9b20-fdef692f4a6d"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:04:50.602999 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-51d49782-a775-4b10-950d-79c8954b31a8 req-8e59f25d-0519-456d-bc82-ca2cd4d03e7a service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:50.603747 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-51d49782-a775-4b10-950d-79c8954b31a8 req-8e59f25d-0519-456d-bc82-ca2cd4d03e7a service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:50.604347 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-51d49782-a775-4b10-950d-79c8954b31a8 req-8e59f25d-0519-456d-bc82-ca2cd4d03e7a service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:50.617820 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.compute.server_external_events [req-51d49782-a775-4b10-950d-79c8954b31a8 req-8e59f25d-0519-456d-bc82-ca2cd4d03e7a service nova] Unable to find a host for instance b456054b-9e50-43c0-ae5a-8f614cbc102b. Dropping event network-vif-unplugged {{(pid=128304) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 26 16:04:50.619447 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-51d49782-a775-4b10-950d-79c8954b31a8 req-8e59f25d-0519-456d-bc82-ca2cd4d03e7a service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.051550 Aug 26 16:04:50.620109 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 581/1173] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 60 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 26 16:04:51.590514 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-2b6f51ef-010f-40a1-b51c-c6ae503c83c6 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:51.593239 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-2b6f51ef-010f-40a1-b51c-c6ae503c83c6 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:51.605949 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2b6f51ef-010f-40a1-b51c-c6ae503c83c6 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:51.606578 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2b6f51ef-010f-40a1-b51c-c6ae503c83c6 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:51.607120 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2b6f51ef-010f-40a1-b51c-c6ae503c83c6 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:51.608933 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2b6f51ef-010f-40a1-b51c-c6ae503c83c6 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:51.611498 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2b6f51ef-010f-40a1-b51c-c6ae503c83c6 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:51.612188 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2b6f51ef-010f-40a1-b51c-c6ae503c83c6 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:51.811403 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-2b6f51ef-010f-40a1-b51c-c6ae503c83c6 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:51.811403 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-2b6f51ef-010f-40a1-b51c-c6ae503c83c6 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1518 microversion: 2.1 time: 0.203094 Aug 26 16:04:51.811403 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 593/1174] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:51 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1518 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:51.917199 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-e4bc288b-4362-4de7-8dc3-468c1fb092ff tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:51.919407 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-e4bc288b-4362-4de7-8dc3-468c1fb092ff tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:51.927589 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e4bc288b-4362-4de7-8dc3-468c1fb092ff tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:51.928203 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e4bc288b-4362-4de7-8dc3-468c1fb092ff tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:51.928834 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e4bc288b-4362-4de7-8dc3-468c1fb092ff tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:51.929958 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e4bc288b-4362-4de7-8dc3-468c1fb092ff tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:51.930525 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e4bc288b-4362-4de7-8dc3-468c1fb092ff tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:51.931104 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e4bc288b-4362-4de7-8dc3-468c1fb092ff tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:51.950590 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-e4bc288b-4362-4de7-8dc3-468c1fb092ff tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] HTTP exception thrown: Instance 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a could not be found. Aug 26 16:04:51.952556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-e4bc288b-4362-4de7-8dc3-468c1fb092ff tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Request method failure captured: Aug 26 16:04:51.952556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: DELETE /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a HTTP/1.1 Aug 26 16:04:51.952556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 16:04:51.952556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 16:04:51.952556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 16:04:51.952556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 0 Aug 26 16:04:51.952556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 16:04:51.952556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 16:04:51.952556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 16:04:51.952556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 16:04:51.952556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO074Vk8Knkkyah_6hQlXk9FvzAhBqPeYMng3gGU-fQ_qYYEN-UvSDuAz2OG4j3gRVAyM63Qk6cGXT3e_LJrqtVIQ2Wh_rCIb7SpxdZF5G6vc_eR0N-2MIzlwTSdPywpn1m7Hkaqaj-3SiKQy1JcwWLQlfAR9RAjH6drO8qCv3BIADQ Aug 26 16:04:51.952556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 16:04:51.952556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 16:04:51.952556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 16:04:51.952556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 16:04:51.952556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 16:04:51.952556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 16:04:51.952556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: d95f731096d74a089f4161f5db69280c Aug 26 16:04:51.952556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:04:51.952556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 16:04:51.952556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 16:04:51.969474 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/d95f731096d74a089f4161f5db69280c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/d95f731096d74a089f4161f5db69280c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/d95f731096d74a089f4161f5db69280c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_d95f731096d74a089f4161f5db69280c", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:04:51.969474 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:04:51.969474 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: d95f731096d74a089f4161f5db69280c Aug 26 16:04:51.969474 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:04:51.969474 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-AttachVolumeNegativeTest-243089979-project Aug 26 16:04:51.969474 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 16:04:51.969474 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 16:04:51.969474 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: b50041d36b0b430badd6442a2f09f063 Aug 26 16:04:51.969474 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-AttachVolumeNegativeTest-243089979-project Aug 26 16:04:51.969474 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: > Aug 26 16:04:51.969474 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Instance 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a could not be found. Aug 26 16:04:51.969474 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'id': '6103553d-b9c7-4ab7-aef1-3fd676bb0a8a'} Aug 26 16:04:51.970363 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:04:51.970363 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:51.970363 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:04:51.970363 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:04:51.970363 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:04:51.970363 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:04:51.970363 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:04:51.970363 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:04:51.970363 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:04:51.970363 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:04:51.970363 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a could not be found. Aug 26 16:04:51.970363 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:51.970363 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:51.970363 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:51.970363 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:51.970363 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:51.970363 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:51.970363 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:04:51.970363 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:04:51.970363 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:04:51.971819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:04:51.971819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 16:04:51.971819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 16:04:51.971819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 16:04:51.971819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 16:04:51.971819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:04:51.971819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:04:51.971819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:04:51.971819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:04:51.971819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a could not be found. Aug 26 16:04:51.971819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:51.971819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:51.971819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:51.971819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:51.971819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:51.971819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:51.971819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:04:51.971819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:04:51.971819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a could not be found. Aug 26 16:04:51.971819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:04:51.973266 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-e4bc288b-4362-4de7-8dc3-468c1fb092ff tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Returning 404 to user: Instance 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a could not be found. {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:04:51.973266 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-e4bc288b-4362-4de7-8dc3-468c1fb092ff tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "DELETE /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 404 len: 111 microversion: 2.1 time: 0.054585 Aug 26 16:04:51.973266 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 582/1175] 10.222.0.94 () {58 vars in 1239 bytes} [Fri Aug 26 16:04:51 2022] DELETE /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:04:51.980517 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-f4a43ae2-09f3-42f1-9cb6-141353287878 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:51.982130 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-f4a43ae2-09f3-42f1-9cb6-141353287878 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] [instance: 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:51.992066 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f4a43ae2-09f3-42f1-9cb6-141353287878 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:51.992563 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f4a43ae2-09f3-42f1-9cb6-141353287878 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:51.993094 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f4a43ae2-09f3-42f1-9cb6-141353287878 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:51.994550 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f4a43ae2-09f3-42f1-9cb6-141353287878 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:51.995043 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f4a43ae2-09f3-42f1-9cb6-141353287878 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:51.995469 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f4a43ae2-09f3-42f1-9cb6-141353287878 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:52.026435 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.wsgi [None req-f4a43ae2-09f3-42f1-9cb6-141353287878 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] HTTP exception thrown: Instance 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a could not be found. Aug 26 16:04:52.028316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-f4a43ae2-09f3-42f1-9cb6-141353287878 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Request method failure captured: Aug 26 16:04:52.028316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: request: GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a HTTP/1.1 Aug 26 16:04:52.028316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept: application/json Aug 26 16:04:52.028316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept-Encoding: identity Aug 26 16:04:52.028316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Connection: close Aug 26 16:04:52.028316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Length: 0 Aug 26 16:04:52.028316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Type: application/json Aug 26 16:04:52.028316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Host: 10.222.0.94 Aug 26 16:04:52.028316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Openstack-System-Scope: None Aug 26 16:04:52.028316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: User-Agent: python-urllib3/1.26.11 Aug 26 16:04:52.028316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Auth-Token: gAAAAABjCO074Vk8Knkkyah_6hQlXk9FvzAhBqPeYMng3gGU-fQ_qYYEN-UvSDuAz2OG4j3gRVAyM63Qk6cGXT3e_LJrqtVIQ2Wh_rCIb7SpxdZF5G6vc_eR0N-2MIzlwTSdPywpn1m7Hkaqaj-3SiKQy1JcwWLQlfAR9RAjH6drO8qCv3BIADQ Aug 26 16:04:52.028316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Id: None Aug 26 16:04:52.028316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Name: None Aug 26 16:04:52.028316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Identity-Status: Confirmed Aug 26 16:04:52.028316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Is-Admin-Project: True Aug 26 16:04:52.028316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Id: default Aug 26 16:04:52.028316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Name: Default Aug 26 16:04:52.028316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Id: d95f731096d74a089f4161f5db69280c Aug 26 16:04:52.028316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Name: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:04:52.028316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Role: member,reader Aug 26 16:04:52.028316 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Roles: member,reader Aug 26 16:04:52.030329 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/d95f731096d74a089f4161f5db69280c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/d95f731096d74a089f4161f5db69280c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/d95f731096d74a089f4161f5db69280c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_d95f731096d74a089f4161f5db69280c", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:04:52.030329 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:04:52.030329 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Id: d95f731096d74a089f4161f5db69280c Aug 26 16:04:52.030329 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-243089979 Aug 26 16:04:52.030329 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User: tempest-AttachVolumeNegativeTest-243089979-project Aug 26 16:04:52.030329 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Id: default Aug 26 16:04:52.030329 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Name: Default Aug 26 16:04:52.030329 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Id: b50041d36b0b430badd6442a2f09f063 Aug 26 16:04:52.030329 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Name: tempest-AttachVolumeNegativeTest-243089979-project Aug 26 16:04:52.030329 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: method: > Aug 26 16:04:52.030329 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: exception: Instance 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a could not be found. Aug 26 16:04:52.030329 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: action_args: {'id': '6103553d-b9c7-4ab7-aef1-3fd676bb0a8a'} Aug 26 16:04:52.031174 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:04:52.031174 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:52.031174 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:04:52.031174 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:04:52.031174 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:04:52.031174 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:04:52.031174 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:04:52.031174 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:04:52.031174 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:04:52.031174 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:04:52.031174 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a could not be found. Aug 26 16:04:52.031174 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:52.031174 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:52.031174 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:52.031174 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:52.031174 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:52.031174 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:52.031174 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:04:52.031174 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:04:52.031174 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:04:52.032375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:04:52.032375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:04:52.032375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:04:52.032375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:04:52.032375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:04:52.032375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:04:52.032375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:04:52.032375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a could not be found. Aug 26 16:04:52.032375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:52.032375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:04:52.032375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:52.032375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:04:52.032375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:04:52.032375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:04:52.032375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:04:52.032375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:04:52.032375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a could not be found. Aug 26 16:04:52.032375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:04:52.033428 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-f4a43ae2-09f3-42f1-9cb6-141353287878 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] Returning 404 to user: Instance 6103553d-b9c7-4ab7-aef1-3fd676bb0a8a could not be found. {{(pid=128305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:04:52.033428 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-f4a43ae2-09f3-42f1-9cb6-141353287878 tempest-AttachVolumeNegativeTest-243089979 tempest-AttachVolumeNegativeTest-243089979-project] 10.222.0.94 "GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a" status: 404 len: 111 microversion: 2.1 time: 0.060110 Aug 26 16:04:52.035090 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 594/1176] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:51 2022] GET /compute/v2.1/servers/6103553d-b9c7-4ab7-aef1-3fd676bb0a8a => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:04:52.814479 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-1c55c859-89b0-496a-b165-fa496df16b78 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:52.815189 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-1c55c859-89b0-496a-b165-fa496df16b78 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:52.822086 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1c55c859-89b0-496a-b165-fa496df16b78 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:52.822590 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1c55c859-89b0-496a-b165-fa496df16b78 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:52.823034 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1c55c859-89b0-496a-b165-fa496df16b78 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:52.823741 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1c55c859-89b0-496a-b165-fa496df16b78 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:52.824194 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1c55c859-89b0-496a-b165-fa496df16b78 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:52.824624 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-1c55c859-89b0-496a-b165-fa496df16b78 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:53.062363 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-1c55c859-89b0-496a-b165-fa496df16b78 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:53.074024 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-1c55c859-89b0-496a-b165-fa496df16b78 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1520 microversion: 2.1 time: 0.264296 Aug 26 16:04:53.076981 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 583/1177] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:52 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:54.104099 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-3e5cdae0-2d04-4ff7-b6b6-1dd7409c3aab tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:54.104720 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-3e5cdae0-2d04-4ff7-b6b6-1dd7409c3aab tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:54.112419 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3e5cdae0-2d04-4ff7-b6b6-1dd7409c3aab tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:54.136133 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3e5cdae0-2d04-4ff7-b6b6-1dd7409c3aab tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:54.143968 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3e5cdae0-2d04-4ff7-b6b6-1dd7409c3aab tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:54.143968 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3e5cdae0-2d04-4ff7-b6b6-1dd7409c3aab tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:54.143968 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3e5cdae0-2d04-4ff7-b6b6-1dd7409c3aab tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:54.143968 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-3e5cdae0-2d04-4ff7-b6b6-1dd7409c3aab tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:54.583455 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-3e5cdae0-2d04-4ff7-b6b6-1dd7409c3aab tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:54.597258 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-3e5cdae0-2d04-4ff7-b6b6-1dd7409c3aab tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1520 microversion: 2.1 time: 0.496666 Aug 26 16:04:54.599779 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 595/1178] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:54 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1520 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:55.625681 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-5a0ea6f5-ffae-4d0d-9859-582442db4943 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:55.627229 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-5a0ea6f5-ffae-4d0d-9859-582442db4943 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:55.641123 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5a0ea6f5-ffae-4d0d-9859-582442db4943 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:55.643772 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5a0ea6f5-ffae-4d0d-9859-582442db4943 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:55.643772 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5a0ea6f5-ffae-4d0d-9859-582442db4943 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:55.643772 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5a0ea6f5-ffae-4d0d-9859-582442db4943 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:55.643772 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5a0ea6f5-ffae-4d0d-9859-582442db4943 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:55.645525 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5a0ea6f5-ffae-4d0d-9859-582442db4943 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:55.903960 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-5a0ea6f5-ffae-4d0d-9859-582442db4943 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:55.922101 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-5a0ea6f5-ffae-4d0d-9859-582442db4943 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1576 microversion: 2.1 time: 0.297977 Aug 26 16:04:55.922737 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 584/1179] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:55 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1576 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:56.952998 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-c3a66315-1da2-41fd-bac3-80e181b5d763 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:56.953758 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-c3a66315-1da2-41fd-bac3-80e181b5d763 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:56.959500 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=3 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:04:56.973094 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c3a66315-1da2-41fd-bac3-80e181b5d763 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:56.979291 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c3a66315-1da2-41fd-bac3-80e181b5d763 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:56.985217 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c3a66315-1da2-41fd-bac3-80e181b5d763 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:56.985217 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c3a66315-1da2-41fd-bac3-80e181b5d763 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:56.985217 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c3a66315-1da2-41fd-bac3-80e181b5d763 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:56.986059 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c3a66315-1da2-41fd-bac3-80e181b5d763 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:57.334166 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-c3a66315-1da2-41fd-bac3-80e181b5d763 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:57.353962 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-c3a66315-1da2-41fd-bac3-80e181b5d763 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1576 microversion: 2.1 time: 0.411938 Aug 26 16:04:57.361445 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 596/1180] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:56 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1576 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:58.387207 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-8ba5474e-b6f7-49fa-b71d-7d3219786076 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:58.388935 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-8ba5474e-b6f7-49fa-b71d-7d3219786076 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:58.398820 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8ba5474e-b6f7-49fa-b71d-7d3219786076 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:58.399947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8ba5474e-b6f7-49fa-b71d-7d3219786076 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:58.400600 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8ba5474e-b6f7-49fa-b71d-7d3219786076 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:58.401534 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8ba5474e-b6f7-49fa-b71d-7d3219786076 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:58.402172 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8ba5474e-b6f7-49fa-b71d-7d3219786076 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:58.402796 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8ba5474e-b6f7-49fa-b71d-7d3219786076 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:58.634606 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-8ba5474e-b6f7-49fa-b71d-7d3219786076 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:58.644974 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-8ba5474e-b6f7-49fa-b71d-7d3219786076 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1576 microversion: 2.1 time: 0.266982 Aug 26 16:04:58.647909 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 585/1181] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:58 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1576 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:04:59.668517 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a4cd89ac-6d4a-4848-94bf-deabe5ecbce2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:04:59.669133 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a4cd89ac-6d4a-4848-94bf-deabe5ecbce2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:04:59.690193 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a4cd89ac-6d4a-4848-94bf-deabe5ecbce2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:59.692758 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a4cd89ac-6d4a-4848-94bf-deabe5ecbce2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:59.699853 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a4cd89ac-6d4a-4848-94bf-deabe5ecbce2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:59.700559 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a4cd89ac-6d4a-4848-94bf-deabe5ecbce2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:04:59.701078 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a4cd89ac-6d4a-4848-94bf-deabe5ecbce2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:04:59.701931 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a4cd89ac-6d4a-4848-94bf-deabe5ecbce2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:04:59.919465 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a4cd89ac-6d4a-4848-94bf-deabe5ecbce2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:04:59.931573 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a4cd89ac-6d4a-4848-94bf-deabe5ecbce2 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1576 microversion: 2.1 time: 0.267411 Aug 26 16:04:59.932770 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 597/1182] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:04:59 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1576 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:00.960007 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-4970d177-9041-4ca8-890a-0cb5807f29d3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:00.963645 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-4970d177-9041-4ca8-890a-0cb5807f29d3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:00.971563 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4970d177-9041-4ca8-890a-0cb5807f29d3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:00.972048 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4970d177-9041-4ca8-890a-0cb5807f29d3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:00.972484 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4970d177-9041-4ca8-890a-0cb5807f29d3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:00.973188 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4970d177-9041-4ca8-890a-0cb5807f29d3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:00.973643 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4970d177-9041-4ca8-890a-0cb5807f29d3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:00.974062 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4970d177-9041-4ca8-890a-0cb5807f29d3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:01.181775 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-4970d177-9041-4ca8-890a-0cb5807f29d3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:01.190295 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-4970d177-9041-4ca8-890a-0cb5807f29d3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1576 microversion: 2.1 time: 0.238615 Aug 26 16:05:01.207430 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 586/1183] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:00 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1576 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:01.530052 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-6a187e26-0b7e-428d-92a3-d19624d17a5d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:01.530052 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-6a187e26-0b7e-428d-92a3-d19624d17a5d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:01.533769 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6a187e26-0b7e-428d-92a3-d19624d17a5d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:01.534265 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6a187e26-0b7e-428d-92a3-d19624d17a5d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:01.535822 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6a187e26-0b7e-428d-92a3-d19624d17a5d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:01.536825 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6a187e26-0b7e-428d-92a3-d19624d17a5d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:01.539758 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6a187e26-0b7e-428d-92a3-d19624d17a5d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:01.540217 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6a187e26-0b7e-428d-92a3-d19624d17a5d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:01.602619 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-6a187e26-0b7e-428d-92a3-d19624d17a5d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.082410 Aug 26 16:05:01.603548 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 587/1184] 10.222.0.94 () {60 vars in 1343 bytes} [Fri Aug 26 16:05:01 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:05:01.692530 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-6478a620-9f06-4b9d-9e62-79ff6a2f7165 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:01.693038 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-6478a620-9f06-4b9d-9e62-79ff6a2f7165 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:01.699444 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6478a620-9f06-4b9d-9e62-79ff6a2f7165 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:01.700199 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6478a620-9f06-4b9d-9e62-79ff6a2f7165 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:01.701169 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6478a620-9f06-4b9d-9e62-79ff6a2f7165 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:01.702205 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6478a620-9f06-4b9d-9e62-79ff6a2f7165 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:01.702826 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6478a620-9f06-4b9d-9e62-79ff6a2f7165 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:01.703440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6478a620-9f06-4b9d-9e62-79ff6a2f7165 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:01.739558 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-6478a620-9f06-4b9d-9e62-79ff6a2f7165 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Going to try to terminate instance {{(pid=128304) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 16:05:01.773175 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-86fad47e-338a-45eb-bfdc-5d2ce13c503e tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Action: 'create', calling method: .version_select at 0x7f15d96da0d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1864094508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpBU9Zwia/KepT4+ew/9mKJE2NHIuEdsOF2i5gtY4ZbP5IO/b9FnXcWoxwWkURmVoG1a8Z6Oo/PPsAjnCU8CTcdeDU3PMJ0VKRMtKxgQoHvWRary/nv67MLleygSLjSJw=="}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:05:01.804407 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-86fad47e-338a-45eb-bfdc-5d2ce13c503e tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Getting quotas for project 3c5f0e0c02e64047b9ca17a7320b0bf5. Resources: {'key_pairs'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 16:05:01.804407 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-86fad47e-338a-45eb-bfdc-5d2ce13c503e tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Getting quotas for user c911a9324cb744a6a1aeb068565d3f89 and project 3c5f0e0c02e64047b9ca17a7320b0bf5. Resources: {'key_pairs'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 16:05:01.963689 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-86fad47e-338a-45eb-bfdc-5d2ce13c503e tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.434108 Aug 26 16:05:01.963689 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 598/1185] 10.222.0.94 () {60 vars in 1159 bytes} [Fri Aug 26 16:05:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:05:02.215300 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-9decff17-33c3-46f9-8216-597a551ff77d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:02.216189 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-9decff17-33c3-46f9-8216-597a551ff77d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:02.225745 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9decff17-33c3-46f9-8216-597a551ff77d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:02.226223 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9decff17-33c3-46f9-8216-597a551ff77d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:02.226831 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9decff17-33c3-46f9-8216-597a551ff77d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:02.227717 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9decff17-33c3-46f9-8216-597a551ff77d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:02.228239 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9decff17-33c3-46f9-8216-597a551ff77d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:02.235009 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9decff17-33c3-46f9-8216-597a551ff77d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:02.274372 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-6478a620-9f06-4b9d-9e62-79ff6a2f7165 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "DELETE /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 204 len: 0 microversion: 2.20 time: 0.585609 Aug 26 16:05:02.275125 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 588/1186] 10.222.0.94 () {60 vars in 1280 bytes} [Fri Aug 26 16:05:01 2022] DELETE /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 0 bytes in 589 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 26 16:05:02.304917 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-44e26b7f-5b51-46ef-b190-b0bc518b1c7d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:02.305902 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-44e26b7f-5b51-46ef-b190-b0bc518b1c7d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:02.313667 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-44e26b7f-5b51-46ef-b190-b0bc518b1c7d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:02.314258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-44e26b7f-5b51-46ef-b190-b0bc518b1c7d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:02.314908 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-44e26b7f-5b51-46ef-b190-b0bc518b1c7d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:02.315741 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-44e26b7f-5b51-46ef-b190-b0bc518b1c7d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:02.316549 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-44e26b7f-5b51-46ef-b190-b0bc518b1c7d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:02.317068 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-44e26b7f-5b51-46ef-b190-b0bc518b1c7d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:02.391235 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-9decff17-33c3-46f9-8216-597a551ff77d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:02.399213 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-9decff17-33c3-46f9-8216-597a551ff77d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1576 microversion: 2.1 time: 0.189425 Aug 26 16:05:02.399789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 599/1187] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:02 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1576 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:05:02.480269 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-44e26b7f-5b51-46ef-b190-b0bc518b1c7d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:02.489418 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-44e26b7f-5b51-46ef-b190-b0bc518b1c7d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:02.493212 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-44e26b7f-5b51-46ef-b190-b0bc518b1c7d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:02.493212 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-44e26b7f-5b51-46ef-b190-b0bc518b1c7d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1725 microversion: 2.20 time: 0.198544 Aug 26 16:05:02.493212 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 589/1188] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:05:02 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:05:03.420914 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-62cd9ee2-e5c6-4596-94ec-ecd64d720974 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:03.421609 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-62cd9ee2-e5c6-4596-94ec-ecd64d720974 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:03.428070 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-62cd9ee2-e5c6-4596-94ec-ecd64d720974 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:03.428612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-62cd9ee2-e5c6-4596-94ec-ecd64d720974 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:03.429054 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-62cd9ee2-e5c6-4596-94ec-ecd64d720974 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:03.429755 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-62cd9ee2-e5c6-4596-94ec-ecd64d720974 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:03.430210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-62cd9ee2-e5c6-4596-94ec-ecd64d720974 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:03.430634 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-62cd9ee2-e5c6-4596-94ec-ecd64d720974 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:03.517361 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-9cf1cede-31af-4e46-812d-90011190631e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:03.518534 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-9cf1cede-31af-4e46-812d-90011190631e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:03.526898 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9cf1cede-31af-4e46-812d-90011190631e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:03.527862 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9cf1cede-31af-4e46-812d-90011190631e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:03.528562 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9cf1cede-31af-4e46-812d-90011190631e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:03.530178 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9cf1cede-31af-4e46-812d-90011190631e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:03.531315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9cf1cede-31af-4e46-812d-90011190631e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:03.535590 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9cf1cede-31af-4e46-812d-90011190631e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:03.659765 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-62cd9ee2-e5c6-4596-94ec-ecd64d720974 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:03.670430 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-62cd9ee2-e5c6-4596-94ec-ecd64d720974 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1576 microversion: 2.1 time: 0.252792 Aug 26 16:05:03.671834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 600/1189] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:03 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1576 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:03.782520 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-9cf1cede-31af-4e46-812d-90011190631e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:03.793797 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-9cf1cede-31af-4e46-812d-90011190631e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:03.795565 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-9cf1cede-31af-4e46-812d-90011190631e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:03.800011 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-9cf1cede-31af-4e46-812d-90011190631e tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1725 microversion: 2.20 time: 0.285557 Aug 26 16:05:03.800011 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 590/1190] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:05:03 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1725 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:05:04.693443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-7c8a0833-5236-4c67-bc7e-737dc791cf9d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:04.694125 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-7c8a0833-5236-4c67-bc7e-737dc791cf9d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:04.700940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7c8a0833-5236-4c67-bc7e-737dc791cf9d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:04.701429 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7c8a0833-5236-4c67-bc7e-737dc791cf9d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:04.709872 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7c8a0833-5236-4c67-bc7e-737dc791cf9d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:04.709872 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7c8a0833-5236-4c67-bc7e-737dc791cf9d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:04.709872 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7c8a0833-5236-4c67-bc7e-737dc791cf9d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:04.709872 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7c8a0833-5236-4c67-bc7e-737dc791cf9d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:04.820719 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-e1ed698b-f7c0-44fc-8f4f-448ff9f700be tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:04.821332 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-e1ed698b-f7c0-44fc-8f4f-448ff9f700be tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:04.833466 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e1ed698b-f7c0-44fc-8f4f-448ff9f700be tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:04.833979 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e1ed698b-f7c0-44fc-8f4f-448ff9f700be tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:04.834415 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e1ed698b-f7c0-44fc-8f4f-448ff9f700be tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:04.835142 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e1ed698b-f7c0-44fc-8f4f-448ff9f700be tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:04.835590 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e1ed698b-f7c0-44fc-8f4f-448ff9f700be tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:04.836008 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-e1ed698b-f7c0-44fc-8f4f-448ff9f700be tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:04.855545 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:05:04.934651 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-7c8a0833-5236-4c67-bc7e-737dc791cf9d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:04.942432 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-7c8a0833-5236-4c67-bc7e-737dc791cf9d tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1576 microversion: 2.1 time: 0.253476 Aug 26 16:05:04.943561 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 601/1191] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:04 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1576 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:05.019855 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e1ed698b-f7c0-44fc-8f4f-448ff9f700be tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:05.030544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e1ed698b-f7c0-44fc-8f4f-448ff9f700be tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:05.032433 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e1ed698b-f7c0-44fc-8f4f-448ff9f700be tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:05.034319 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-e1ed698b-f7c0-44fc-8f4f-448ff9f700be tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1725 microversion: 2.20 time: 0.217417 Aug 26 16:05:05.035454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 591/1192] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:05:04 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:05:05.968635 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-26f7b270-b96f-4f96-8c30-fd6a1f958c28 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:05.969480 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-26f7b270-b96f-4f96-8c30-fd6a1f958c28 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:05.976873 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-26f7b270-b96f-4f96-8c30-fd6a1f958c28 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:05.981797 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-26f7b270-b96f-4f96-8c30-fd6a1f958c28 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:05.981797 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-26f7b270-b96f-4f96-8c30-fd6a1f958c28 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:05.981797 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-26f7b270-b96f-4f96-8c30-fd6a1f958c28 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:05.981797 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-26f7b270-b96f-4f96-8c30-fd6a1f958c28 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:05.982973 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-26f7b270-b96f-4f96-8c30-fd6a1f958c28 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:06.061939 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f27cf43b-8827-4f20-97cb-bd73b59deff0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:06.062718 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-f27cf43b-8827-4f20-97cb-bd73b59deff0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:06.070633 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f27cf43b-8827-4f20-97cb-bd73b59deff0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:06.071182 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f27cf43b-8827-4f20-97cb-bd73b59deff0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:06.071627 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f27cf43b-8827-4f20-97cb-bd73b59deff0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:06.072562 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f27cf43b-8827-4f20-97cb-bd73b59deff0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:06.073507 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f27cf43b-8827-4f20-97cb-bd73b59deff0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:06.073507 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f27cf43b-8827-4f20-97cb-bd73b59deff0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:06.137032 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-26f7b270-b96f-4f96-8c30-fd6a1f958c28 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:06.145377 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-26f7b270-b96f-4f96-8c30-fd6a1f958c28 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1576 microversion: 2.1 time: 0.181328 Aug 26 16:05:06.146122 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 602/1193] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:05 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:06.223828 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-f27cf43b-8827-4f20-97cb-bd73b59deff0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:06.233823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-f27cf43b-8827-4f20-97cb-bd73b59deff0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:06.235629 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-f27cf43b-8827-4f20-97cb-bd73b59deff0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:06.237041 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-f27cf43b-8827-4f20-97cb-bd73b59deff0 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1725 microversion: 2.20 time: 0.180318 Aug 26 16:05:06.237611 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 592/1194] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:05:06 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:05:07.167828 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-7eab568a-d441-477e-bfb6-bd1d2aabea61 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:07.169440 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-7eab568a-d441-477e-bfb6-bd1d2aabea61 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:07.181019 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7eab568a-d441-477e-bfb6-bd1d2aabea61 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:07.182568 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7eab568a-d441-477e-bfb6-bd1d2aabea61 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:07.185786 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7eab568a-d441-477e-bfb6-bd1d2aabea61 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:07.186528 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7eab568a-d441-477e-bfb6-bd1d2aabea61 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:07.187697 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7eab568a-d441-477e-bfb6-bd1d2aabea61 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:07.188435 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7eab568a-d441-477e-bfb6-bd1d2aabea61 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:07.263347 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-96bd9de9-69b3-4d5a-b272-f34e5cdb9933 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:07.264654 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-96bd9de9-69b3-4d5a-b272-f34e5cdb9933 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:07.273508 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-96bd9de9-69b3-4d5a-b272-f34e5cdb9933 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:07.274162 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-96bd9de9-69b3-4d5a-b272-f34e5cdb9933 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:07.274611 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-96bd9de9-69b3-4d5a-b272-f34e5cdb9933 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:07.275387 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-96bd9de9-69b3-4d5a-b272-f34e5cdb9933 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:07.276027 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-96bd9de9-69b3-4d5a-b272-f34e5cdb9933 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:07.276507 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-96bd9de9-69b3-4d5a-b272-f34e5cdb9933 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:07.394945 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-96bd9de9-69b3-4d5a-b272-f34e5cdb9933 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:07.407517 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-96bd9de9-69b3-4d5a-b272-f34e5cdb9933 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:07.415626 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-96bd9de9-69b3-4d5a-b272-f34e5cdb9933 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:07.417903 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-96bd9de9-69b3-4d5a-b272-f34e5cdb9933 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1657 microversion: 2.20 time: 0.160364 Aug 26 16:05:07.420132 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 593/1195] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:05:07 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1657 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 16:05:07.428133 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-7eab568a-d441-477e-bfb6-bd1d2aabea61 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:07.440010 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-7eab568a-d441-477e-bfb6-bd1d2aabea61 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1576 microversion: 2.1 time: 0.276138 Aug 26 16:05:07.451872 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 603/1196] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:07 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1576 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:07.580935 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-00e061cf-0880-4eaf-9bdf-aaba26c25a2a req-5993adce-ea4e-4f2b-90e1-180265a08724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fc0c879-6083-414b-b6ee-2046538f526f", "name": "network-vif-deleted", "tag": "5921e1e6-5379-4181-b413-94122520d6d1"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:05:07.607119 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-00e061cf-0880-4eaf-9bdf-aaba26c25a2a req-5993adce-ea4e-4f2b-90e1-180265a08724 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:07.608122 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-00e061cf-0880-4eaf-9bdf-aaba26c25a2a req-5993adce-ea4e-4f2b-90e1-180265a08724 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:07.609220 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-00e061cf-0880-4eaf-9bdf-aaba26c25a2a req-5993adce-ea4e-4f2b-90e1-180265a08724 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:07.625551 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-00e061cf-0880-4eaf-9bdf-aaba26c25a2a req-5993adce-ea4e-4f2b-90e1-180265a08724 service nova] Creating event network-vif-deleted:5921e1e6-5379-4181-b413-94122520d6d1 for instance 3fc0c879-6083-414b-b6ee-2046538f526f on hv-cinder-85144 Aug 26 16:05:07.632073 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-00e061cf-0880-4eaf-9bdf-aaba26c25a2a req-5993adce-ea4e-4f2b-90e1-180265a08724 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055019 Aug 26 16:05:07.633113 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 594/1197] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:05:08.452857 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-ff33c67e-53e0-4836-b5e5-33638a2ee956 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:08.454549 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-ff33c67e-53e0-4836-b5e5-33638a2ee956 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:08.465021 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ff33c67e-53e0-4836-b5e5-33638a2ee956 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:08.465021 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ff33c67e-53e0-4836-b5e5-33638a2ee956 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:08.465021 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ff33c67e-53e0-4836-b5e5-33638a2ee956 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:08.465021 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ff33c67e-53e0-4836-b5e5-33638a2ee956 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:08.465447 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ff33c67e-53e0-4836-b5e5-33638a2ee956 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:08.465447 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ff33c67e-53e0-4836-b5e5-33638a2ee956 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:08.473007 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-bd8256dd-6f8a-4ea9-8d18-ec6fa770bb43 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:08.473710 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-bd8256dd-6f8a-4ea9-8d18-ec6fa770bb43 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:08.491059 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bd8256dd-6f8a-4ea9-8d18-ec6fa770bb43 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:08.491563 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bd8256dd-6f8a-4ea9-8d18-ec6fa770bb43 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:08.492006 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bd8256dd-6f8a-4ea9-8d18-ec6fa770bb43 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:08.492715 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bd8256dd-6f8a-4ea9-8d18-ec6fa770bb43 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:08.493201 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bd8256dd-6f8a-4ea9-8d18-ec6fa770bb43 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:08.493623 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-bd8256dd-6f8a-4ea9-8d18-ec6fa770bb43 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:08.507631 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ff33c67e-53e0-4836-b5e5-33638a2ee956 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:08.508421 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ff33c67e-53e0-4836-b5e5-33638a2ee956 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:08.508901 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ff33c67e-53e0-4836-b5e5-33638a2ee956 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:08.509522 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-ff33c67e-53e0-4836-b5e5-33638a2ee956 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lazy-loading 'fault' on Instance uuid 3fc0c879-6083-414b-b6ee-2046538f526f {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:05:08.569512 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-ff33c67e-53e0-4836-b5e5-33638a2ee956 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:08.581948 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-ff33c67e-53e0-4836-b5e5-33638a2ee956 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:08.583818 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-ff33c67e-53e0-4836-b5e5-33638a2ee956 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:08.585096 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-ff33c67e-53e0-4836-b5e5-33638a2ee956 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1372 microversion: 2.20 time: 0.143387 Aug 26 16:05:08.586145 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 604/1198] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:05:08 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1372 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:05:08.683432 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-bd8256dd-6f8a-4ea9-8d18-ec6fa770bb43 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:08.695114 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-bd8256dd-6f8a-4ea9-8d18-ec6fa770bb43 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1576 microversion: 2.1 time: 0.226807 Aug 26 16:05:08.696142 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 595/1199] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:08 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1576 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:09.609036 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-c7ebe4c1-4933-4c98-a52e-9927c59ef100 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:09.609636 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-c7ebe4c1-4933-4c98-a52e-9927c59ef100 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:09.616175 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c7ebe4c1-4933-4c98-a52e-9927c59ef100 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:09.616652 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c7ebe4c1-4933-4c98-a52e-9927c59ef100 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:09.617080 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c7ebe4c1-4933-4c98-a52e-9927c59ef100 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:09.617834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c7ebe4c1-4933-4c98-a52e-9927c59ef100 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:09.618357 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c7ebe4c1-4933-4c98-a52e-9927c59ef100 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:09.618781 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c7ebe4c1-4933-4c98-a52e-9927c59ef100 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:09.653696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c7ebe4c1-4933-4c98-a52e-9927c59ef100 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:09.654169 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c7ebe4c1-4933-4c98-a52e-9927c59ef100 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:09.654672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-c7ebe4c1-4933-4c98-a52e-9927c59ef100 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:09.655067 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-c7ebe4c1-4933-4c98-a52e-9927c59ef100 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lazy-loading 'fault' on Instance uuid 3fc0c879-6083-414b-b6ee-2046538f526f {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:05:09.702395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-c7ebe4c1-4933-4c98-a52e-9927c59ef100 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:09.710605 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-c7ebe4c1-4933-4c98-a52e-9927c59ef100 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:09.712134 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-c7ebe4c1-4933-4c98-a52e-9927c59ef100 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '228837054cd648acb0df93dd423e1d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bfb4199b0d4a57933fe1b685aa01cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:09.713291 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-c7ebe4c1-4933-4c98-a52e-9927c59ef100 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 200 len: 1372 microversion: 2.20 time: 0.109062 Aug 26 16:05:09.714020 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 605/1200] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:05:09 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 16:05:09.718682 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-639fd585-1de7-42d7-b461-81bb776f6288 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:09.726378 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-639fd585-1de7-42d7-b461-81bb776f6288 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:09.726378 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-639fd585-1de7-42d7-b461-81bb776f6288 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:09.726378 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-639fd585-1de7-42d7-b461-81bb776f6288 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:09.726677 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-639fd585-1de7-42d7-b461-81bb776f6288 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:09.727251 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-639fd585-1de7-42d7-b461-81bb776f6288 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:09.727700 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-639fd585-1de7-42d7-b461-81bb776f6288 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:09.728119 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-639fd585-1de7-42d7-b461-81bb776f6288 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:09.868253 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-639fd585-1de7-42d7-b461-81bb776f6288 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:09.876093 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-639fd585-1de7-42d7-b461-81bb776f6288 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1576 microversion: 2.1 time: 0.162431 Aug 26 16:05:09.876672 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 596/1201] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:09 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:05:10.735826 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-cd9117df-baca-4bf5-a621-ec7908a15c48 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:10.736368 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-cd9117df-baca-4bf5-a621-ec7908a15c48 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:10.742980 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cd9117df-baca-4bf5-a621-ec7908a15c48 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:10.743462 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cd9117df-baca-4bf5-a621-ec7908a15c48 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:10.743923 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cd9117df-baca-4bf5-a621-ec7908a15c48 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:10.744599 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cd9117df-baca-4bf5-a621-ec7908a15c48 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:10.745046 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cd9117df-baca-4bf5-a621-ec7908a15c48 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:10.745487 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cd9117df-baca-4bf5-a621-ec7908a15c48 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:10.759513 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.wsgi [None req-cd9117df-baca-4bf5-a621-ec7908a15c48 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] HTTP exception thrown: Instance 3fc0c879-6083-414b-b6ee-2046538f526f could not be found. Aug 26 16:05:10.761127 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-cd9117df-baca-4bf5-a621-ec7908a15c48 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Request method failure captured: Aug 26 16:05:10.761127 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: request: GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f HTTP/1.1 Aug 26 16:05:10.761127 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept: application/json Aug 26 16:05:10.761127 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept-Encoding: identity Aug 26 16:05:10.761127 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Connection: close Aug 26 16:05:10.761127 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Length: 0 Aug 26 16:05:10.761127 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Type: application/json Aug 26 16:05:10.761127 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Host: 10.222.0.94 Aug 26 16:05:10.761127 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Openstack-System-Scope: None Aug 26 16:05:10.761127 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: User-Agent: python-urllib3/1.26.11 Aug 26 16:05:10.761127 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Auth-Token: gAAAAABjCO1F1UfIrbIIIqx800DhgBQ_xLKUPQNDExaayaNWSrORPZqmlaNEr9-HCq5faaWsVbGXZxapKHPq-pZ9plOFRfzz3LDwvmt0IPrL8R0nR1c0gI7mXph447z8r464fSPa-J2FQWiNavpaQfTuChWNsILpXatKerRG5u9XFwxbJRh2x3U Aug 26 16:05:10.761127 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Id: None Aug 26 16:05:10.761127 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Name: None Aug 26 16:05:10.761127 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Identity-Status: Confirmed Aug 26 16:05:10.761127 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Is-Admin-Project: True Aug 26 16:05:10.761127 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 16:05:10.761127 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Id: default Aug 26 16:05:10.761127 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Name: Default Aug 26 16:05:10.761127 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Id: e8bfb4199b0d4a57933fe1b685aa01cd Aug 26 16:05:10.761127 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-752766866 Aug 26 16:05:10.761127 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Role: member,reader Aug 26 16:05:10.761127 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Roles: member,reader Aug 26 16:05:10.762816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/e8bfb4199b0d4a57933fe1b685aa01cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/e8bfb4199b0d4a57933fe1b685aa01cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/e8bfb4199b0d4a57933fe1b685aa01cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_e8bfb4199b0d4a57933fe1b685aa01cd", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:05:10.762816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant: tempest-AttachVolumeShelveTestJSON-752766866 Aug 26 16:05:10.762816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Id: e8bfb4199b0d4a57933fe1b685aa01cd Aug 26 16:05:10.762816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-752766866 Aug 26 16:05:10.762816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User: tempest-AttachVolumeShelveTestJSON-752766866-project Aug 26 16:05:10.762816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Id: default Aug 26 16:05:10.762816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Name: Default Aug 26 16:05:10.762816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Id: 228837054cd648acb0df93dd423e1d83 Aug 26 16:05:10.762816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Name: tempest-AttachVolumeShelveTestJSON-752766866-project Aug 26 16:05:10.762816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: method: > Aug 26 16:05:10.762816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: exception: Instance 3fc0c879-6083-414b-b6ee-2046538f526f could not be found. Aug 26 16:05:10.762816 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: action_args: {'id': '3fc0c879-6083-414b-b6ee-2046538f526f'} Aug 26 16:05:10.764722 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:05:10.764722 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:10.764722 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:05:10.764722 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:05:10.764722 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:05:10.764722 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:05:10.764722 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:05:10.764722 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:05:10.764722 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:05:10.764722 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:05:10.764722 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fc0c879-6083-414b-b6ee-2046538f526f could not be found. Aug 26 16:05:10.764722 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:10.764722 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:05:10.764722 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:10.764722 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:10.764722 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:05:10.764722 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:05:10.764722 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:05:10.764722 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:05:10.764722 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:05:10.766295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:05:10.766295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:05:10.766295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:05:10.766295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:05:10.766295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:05:10.766295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:05:10.766295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:05:10.766295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fc0c879-6083-414b-b6ee-2046538f526f could not be found. Aug 26 16:05:10.766295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:10.766295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:05:10.766295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:10.766295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:10.766295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:05:10.766295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:05:10.766295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:05:10.766295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:05:10.766295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fc0c879-6083-414b-b6ee-2046538f526f could not be found. Aug 26 16:05:10.766295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:10.767813 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-cd9117df-baca-4bf5-a621-ec7908a15c48 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Returning 404 to user: Instance 3fc0c879-6083-414b-b6ee-2046538f526f could not be found. {{(pid=128305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:05:10.767813 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-cd9117df-baca-4bf5-a621-ec7908a15c48 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 404 len: 111 microversion: 2.20 time: 0.030683 Aug 26 16:05:10.767813 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 606/1202] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:05:10 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 16:05:10.772752 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-d0ebee2e-37cb-4253-af6e-aae555b2e83d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '.version_select at 0x7f15d96c3f70>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:10.880972 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-d0ebee2e-37cb-4253-af6e-aae555b2e83d tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1678684181" status: 204 len: 0 microversion: 2.20 time: 0.112149 Aug 26 16:05:10.881597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 597/1203] 10.222.0.94 () {60 vars in 1262 bytes} [Fri Aug 26 16:05:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1678684181 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 26 16:05:10.897386 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-ad546099-b288-40d8-a1ef-df5d3edf0912 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:10.898001 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-ad546099-b288-40d8-a1ef-df5d3edf0912 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:10.904226 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ad546099-b288-40d8-a1ef-df5d3edf0912 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:10.904704 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ad546099-b288-40d8-a1ef-df5d3edf0912 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:10.905133 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ad546099-b288-40d8-a1ef-df5d3edf0912 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:10.905832 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ad546099-b288-40d8-a1ef-df5d3edf0912 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:10.906275 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ad546099-b288-40d8-a1ef-df5d3edf0912 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:10.906693 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ad546099-b288-40d8-a1ef-df5d3edf0912 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:11.041969 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-ad546099-b288-40d8-a1ef-df5d3edf0912 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:11.050081 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-ad546099-b288-40d8-a1ef-df5d3edf0912 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1576 microversion: 2.1 time: 0.156524 Aug 26 16:05:11.050650 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 607/1204] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:10 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:12.074129 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-89159da9-e75a-4ba0-8bb9-b131e88a43e3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:12.074747 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-89159da9-e75a-4ba0-8bb9-b131e88a43e3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:12.080837 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-89159da9-e75a-4ba0-8bb9-b131e88a43e3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:12.081323 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-89159da9-e75a-4ba0-8bb9-b131e88a43e3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:12.081758 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-89159da9-e75a-4ba0-8bb9-b131e88a43e3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:12.082460 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-89159da9-e75a-4ba0-8bb9-b131e88a43e3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:12.082929 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-89159da9-e75a-4ba0-8bb9-b131e88a43e3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:12.083355 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-89159da9-e75a-4ba0-8bb9-b131e88a43e3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:12.230905 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-89159da9-e75a-4ba0-8bb9-b131e88a43e3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:12.239509 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-89159da9-e75a-4ba0-8bb9-b131e88a43e3 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1576 microversion: 2.1 time: 0.171157 Aug 26 16:05:12.240092 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 598/1205] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:12 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:13.027483 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-80d327cb-dae9-412c-9a18-d65326043fdb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:13.027976 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-80d327cb-dae9-412c-9a18-d65326043fdb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:13.031143 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell0:SELECT=4 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:05:13.035919 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-80d327cb-dae9-412c-9a18-d65326043fdb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:13.036399 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-80d327cb-dae9-412c-9a18-d65326043fdb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:13.036830 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-80d327cb-dae9-412c-9a18-d65326043fdb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:13.037518 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-80d327cb-dae9-412c-9a18-d65326043fdb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:13.037971 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-80d327cb-dae9-412c-9a18-d65326043fdb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:13.038392 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-80d327cb-dae9-412c-9a18-d65326043fdb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:13.052730 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.wsgi [None req-80d327cb-dae9-412c-9a18-d65326043fdb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] HTTP exception thrown: Instance 3fc0c879-6083-414b-b6ee-2046538f526f could not be found. Aug 26 16:05:13.057364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-80d327cb-dae9-412c-9a18-d65326043fdb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Request method failure captured: Aug 26 16:05:13.057364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: request: DELETE /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f HTTP/1.1 Aug 26 16:05:13.057364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept: application/json Aug 26 16:05:13.057364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept-Encoding: identity Aug 26 16:05:13.057364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Connection: close Aug 26 16:05:13.057364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Length: 0 Aug 26 16:05:13.057364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Type: application/json Aug 26 16:05:13.057364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Host: 10.222.0.94 Aug 26 16:05:13.057364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Openstack-System-Scope: None Aug 26 16:05:13.057364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: User-Agent: python-urllib3/1.26.11 Aug 26 16:05:13.057364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Auth-Token: gAAAAABjCO1F1UfIrbIIIqx800DhgBQ_xLKUPQNDExaayaNWSrORPZqmlaNEr9-HCq5faaWsVbGXZxapKHPq-pZ9plOFRfzz3LDwvmt0IPrL8R0nR1c0gI7mXph447z8r464fSPa-J2FQWiNavpaQfTuChWNsILpXatKerRG5u9XFwxbJRh2x3U Aug 26 16:05:13.057364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Id: None Aug 26 16:05:13.057364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Name: None Aug 26 16:05:13.057364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Identity-Status: Confirmed Aug 26 16:05:13.057364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Is-Admin-Project: True Aug 26 16:05:13.057364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 16:05:13.057364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Id: default Aug 26 16:05:13.057364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Name: Default Aug 26 16:05:13.057364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Id: e8bfb4199b0d4a57933fe1b685aa01cd Aug 26 16:05:13.057364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-752766866 Aug 26 16:05:13.057364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Role: member,reader Aug 26 16:05:13.057364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Roles: member,reader Aug 26 16:05:13.059161 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/e8bfb4199b0d4a57933fe1b685aa01cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/e8bfb4199b0d4a57933fe1b685aa01cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/e8bfb4199b0d4a57933fe1b685aa01cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_e8bfb4199b0d4a57933fe1b685aa01cd", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:05:13.059161 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant: tempest-AttachVolumeShelveTestJSON-752766866 Aug 26 16:05:13.059161 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Id: e8bfb4199b0d4a57933fe1b685aa01cd Aug 26 16:05:13.059161 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-752766866 Aug 26 16:05:13.059161 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User: tempest-AttachVolumeShelveTestJSON-752766866-project Aug 26 16:05:13.059161 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Id: default Aug 26 16:05:13.059161 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Name: Default Aug 26 16:05:13.059161 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Id: 228837054cd648acb0df93dd423e1d83 Aug 26 16:05:13.059161 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Name: tempest-AttachVolumeShelveTestJSON-752766866-project Aug 26 16:05:13.059161 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: method: > Aug 26 16:05:13.059161 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: exception: Instance 3fc0c879-6083-414b-b6ee-2046538f526f could not be found. Aug 26 16:05:13.059161 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: action_args: {'id': '3fc0c879-6083-414b-b6ee-2046538f526f'} Aug 26 16:05:13.060696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:05:13.060696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:13.060696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:05:13.060696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:05:13.060696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:05:13.060696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:05:13.060696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:05:13.060696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:05:13.060696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:05:13.060696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:05:13.060696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fc0c879-6083-414b-b6ee-2046538f526f could not be found. Aug 26 16:05:13.060696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:13.060696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:05:13.060696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:13.060696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:13.060696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:05:13.060696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:05:13.060696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:05:13.060696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:05:13.060696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:05:13.062165 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:05:13.062165 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 16:05:13.062165 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 16:05:13.062165 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 16:05:13.062165 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 16:05:13.062165 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:05:13.062165 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:05:13.062165 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:05:13.062165 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:05:13.062165 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fc0c879-6083-414b-b6ee-2046538f526f could not be found. Aug 26 16:05:13.062165 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:13.062165 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:05:13.062165 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:13.062165 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:13.062165 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:05:13.062165 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:05:13.062165 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:05:13.062165 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:05:13.062165 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fc0c879-6083-414b-b6ee-2046538f526f could not be found. Aug 26 16:05:13.062165 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:13.063799 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-80d327cb-dae9-412c-9a18-d65326043fdb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Returning 404 to user: Instance 3fc0c879-6083-414b-b6ee-2046538f526f could not be found. {{(pid=128305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:05:13.063799 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-80d327cb-dae9-412c-9a18-d65326043fdb tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "DELETE /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 404 len: 111 microversion: 2.20 time: 0.032063 Aug 26 16:05:13.063799 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 608/1206] 10.222.0.94 () {60 vars in 1280 bytes} [Fri Aug 26 16:05:13 2022] DELETE /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 16:05:13.064964 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-19a61690-3af5-4d7e-a32c-eaf11a2cac19 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:13.065829 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-19a61690-3af5-4d7e-a32c-eaf11a2cac19 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 3fc0c879-6083-414b-b6ee-2046538f526f] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:13.072199 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-19a61690-3af5-4d7e-a32c-eaf11a2cac19 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:13.072694 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-19a61690-3af5-4d7e-a32c-eaf11a2cac19 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:13.073142 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-19a61690-3af5-4d7e-a32c-eaf11a2cac19 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:13.073831 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-19a61690-3af5-4d7e-a32c-eaf11a2cac19 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:13.074287 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-19a61690-3af5-4d7e-a32c-eaf11a2cac19 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:13.074846 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-19a61690-3af5-4d7e-a32c-eaf11a2cac19 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:13.089027 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-19a61690-3af5-4d7e-a32c-eaf11a2cac19 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] HTTP exception thrown: Instance 3fc0c879-6083-414b-b6ee-2046538f526f could not be found. Aug 26 16:05:13.090671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-19a61690-3af5-4d7e-a32c-eaf11a2cac19 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Request method failure captured: Aug 26 16:05:13.090671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f HTTP/1.1 Aug 26 16:05:13.090671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 16:05:13.090671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 16:05:13.090671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 16:05:13.090671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 0 Aug 26 16:05:13.090671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 16:05:13.090671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 16:05:13.090671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 16:05:13.090671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 16:05:13.090671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO1F1UfIrbIIIqx800DhgBQ_xLKUPQNDExaayaNWSrORPZqmlaNEr9-HCq5faaWsVbGXZxapKHPq-pZ9plOFRfzz3LDwvmt0IPrL8R0nR1c0gI7mXph447z8r464fSPa-J2FQWiNavpaQfTuChWNsILpXatKerRG5u9XFwxbJRh2x3U Aug 26 16:05:13.090671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 16:05:13.090671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 16:05:13.090671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 16:05:13.090671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 16:05:13.090671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 16:05:13.090671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 16:05:13.090671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 16:05:13.090671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: e8bfb4199b0d4a57933fe1b685aa01cd Aug 26 16:05:13.090671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-752766866 Aug 26 16:05:13.090671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 16:05:13.090671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 16:05:13.092493 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/e8bfb4199b0d4a57933fe1b685aa01cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/e8bfb4199b0d4a57933fe1b685aa01cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/e8bfb4199b0d4a57933fe1b685aa01cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_e8bfb4199b0d4a57933fe1b685aa01cd", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:05:13.092493 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-AttachVolumeShelveTestJSON-752766866 Aug 26 16:05:13.092493 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: e8bfb4199b0d4a57933fe1b685aa01cd Aug 26 16:05:13.092493 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-752766866 Aug 26 16:05:13.092493 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-AttachVolumeShelveTestJSON-752766866-project Aug 26 16:05:13.092493 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 16:05:13.092493 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 16:05:13.092493 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: 228837054cd648acb0df93dd423e1d83 Aug 26 16:05:13.092493 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-AttachVolumeShelveTestJSON-752766866-project Aug 26 16:05:13.092493 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: > Aug 26 16:05:13.092493 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Instance 3fc0c879-6083-414b-b6ee-2046538f526f could not be found. Aug 26 16:05:13.092493 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'id': '3fc0c879-6083-414b-b6ee-2046538f526f'} Aug 26 16:05:13.093419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:05:13.093419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:13.093419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:05:13.093419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:05:13.093419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:05:13.093419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:05:13.093419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:05:13.093419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:05:13.093419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:05:13.093419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:05:13.093419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fc0c879-6083-414b-b6ee-2046538f526f could not be found. Aug 26 16:05:13.093419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:05:13.093419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:05:13.093419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:05:13.093419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:13.093419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:05:13.093419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:05:13.093419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:05:13.093419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:05:13.093419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:05:13.094946 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:05:13.094946 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:05:13.094946 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:05:13.094946 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:05:13.094946 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:05:13.094946 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:05:13.094946 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:05:13.094946 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fc0c879-6083-414b-b6ee-2046538f526f could not be found. Aug 26 16:05:13.094946 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:05:13.094946 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:05:13.094946 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:05:13.094946 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:13.094946 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:05:13.094946 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:05:13.094946 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:05:13.094946 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:05:13.094946 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fc0c879-6083-414b-b6ee-2046538f526f could not be found. Aug 26 16:05:13.094946 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:05:13.096428 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-19a61690-3af5-4d7e-a32c-eaf11a2cac19 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Returning 404 to user: Instance 3fc0c879-6083-414b-b6ee-2046538f526f could not be found. {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:05:13.096428 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-19a61690-3af5-4d7e-a32c-eaf11a2cac19 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f" status: 404 len: 111 microversion: 2.20 time: 0.031763 Aug 26 16:05:13.096428 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 599/1207] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:05:13 2022] GET /compute/v2.1/servers/3fc0c879-6083-414b-b6ee-2046538f526f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 16:05:13.261849 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-1b58d3bf-9f33-4b9a-889c-c54f9077887c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:13.262598 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-1b58d3bf-9f33-4b9a-889c-c54f9077887c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:13.269505 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1b58d3bf-9f33-4b9a-889c-c54f9077887c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:13.269984 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1b58d3bf-9f33-4b9a-889c-c54f9077887c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:13.270417 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1b58d3bf-9f33-4b9a-889c-c54f9077887c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:13.271140 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1b58d3bf-9f33-4b9a-889c-c54f9077887c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:13.271591 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1b58d3bf-9f33-4b9a-889c-c54f9077887c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:13.272011 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1b58d3bf-9f33-4b9a-889c-c54f9077887c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:13.440084 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-1b58d3bf-9f33-4b9a-889c-c54f9077887c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:13.448117 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-1b58d3bf-9f33-4b9a-889c-c54f9077887c tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1576 microversion: 2.1 time: 0.190287 Aug 26 16:05:13.448751 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 609/1208] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:13 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1576 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:13.691253 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-12d25355-de8f-451d-9b48-37cb06463729 req-ea1c9a14-44da-4095-8ec6-a83d1956c9d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b456054b-9e50-43c0-ae5a-8f614cbc102b", "name": "network-vif-plugged", "status": "completed", "tag": "7450399c-70d1-4b9d-9b20-fdef692f4a6d"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:05:13.702783 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-12d25355-de8f-451d-9b48-37cb06463729 req-ea1c9a14-44da-4095-8ec6-a83d1956c9d5 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:13.703291 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-12d25355-de8f-451d-9b48-37cb06463729 req-ea1c9a14-44da-4095-8ec6-a83d1956c9d5 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:13.703732 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-12d25355-de8f-451d-9b48-37cb06463729 req-ea1c9a14-44da-4095-8ec6-a83d1956c9d5 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:13.715140 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-12d25355-de8f-451d-9b48-37cb06463729 req-ea1c9a14-44da-4095-8ec6-a83d1956c9d5 service nova] Creating event network-vif-plugged:7450399c-70d1-4b9d-9b20-fdef692f4a6d for instance b456054b-9e50-43c0-ae5a-8f614cbc102b on hv-cinder-85144 Aug 26 16:05:13.720663 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-12d25355-de8f-451d-9b48-37cb06463729 req-ea1c9a14-44da-4095-8ec6-a83d1956c9d5 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033805 Aug 26 16:05:13.721265 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 600/1209] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:05:14.467060 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-0c649d84-5acc-4235-8613-d214b03f24e2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:14.467634 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-0c649d84-5acc-4235-8613-d214b03f24e2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:14.471383 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7facac2c-d16d-4adc-9aff-e592b9eb17d5 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:14.472242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-7facac2c-d16d-4adc-9aff-e592b9eb17d5 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:14.474158 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0c649d84-5acc-4235-8613-d214b03f24e2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:14.474649 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0c649d84-5acc-4235-8613-d214b03f24e2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:14.475123 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0c649d84-5acc-4235-8613-d214b03f24e2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:14.476499 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0c649d84-5acc-4235-8613-d214b03f24e2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:14.476499 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0c649d84-5acc-4235-8613-d214b03f24e2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:14.476733 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-0c649d84-5acc-4235-8613-d214b03f24e2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:14.480600 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7facac2c-d16d-4adc-9aff-e592b9eb17d5 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:14.484298 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7facac2c-d16d-4adc-9aff-e592b9eb17d5 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:14.484848 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7facac2c-d16d-4adc-9aff-e592b9eb17d5 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:14.485698 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7facac2c-d16d-4adc-9aff-e592b9eb17d5 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:14.486153 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7facac2c-d16d-4adc-9aff-e592b9eb17d5 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:14.486584 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7facac2c-d16d-4adc-9aff-e592b9eb17d5 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:14.492330 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.wsgi [None req-0c649d84-5acc-4235-8613-d214b03f24e2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] HTTP exception thrown: Instance 8ac977a7-aa08-459a-a863-36ba667422d1 could not be found. Aug 26 16:05:14.493264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-0c649d84-5acc-4235-8613-d214b03f24e2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Request method failure captured: Aug 26 16:05:14.493264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: request: DELETE /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 HTTP/1.1 Aug 26 16:05:14.493264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept: application/json Aug 26 16:05:14.493264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept-Encoding: identity Aug 26 16:05:14.493264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Connection: close Aug 26 16:05:14.493264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Length: 0 Aug 26 16:05:14.493264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Type: application/json Aug 26 16:05:14.493264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Host: 10.222.0.94 Aug 26 16:05:14.493264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Openstack-System-Scope: None Aug 26 16:05:14.493264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: User-Agent: python-urllib3/1.26.11 Aug 26 16:05:14.493264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Auth-Token: gAAAAABjCO1F1UfIrbIIIqx800DhgBQ_xLKUPQNDExaayaNWSrORPZqmlaNEr9-HCq5faaWsVbGXZxapKHPq-pZ9plOFRfzz3LDwvmt0IPrL8R0nR1c0gI7mXph447z8r464fSPa-J2FQWiNavpaQfTuChWNsILpXatKerRG5u9XFwxbJRh2x3U Aug 26 16:05:14.493264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Id: None Aug 26 16:05:14.493264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Name: None Aug 26 16:05:14.493264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Identity-Status: Confirmed Aug 26 16:05:14.493264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Is-Admin-Project: True Aug 26 16:05:14.493264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 16:05:14.493264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Id: default Aug 26 16:05:14.493264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Name: Default Aug 26 16:05:14.493264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Id: e8bfb4199b0d4a57933fe1b685aa01cd Aug 26 16:05:14.493264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-752766866 Aug 26 16:05:14.493264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Role: member,reader Aug 26 16:05:14.493264 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Roles: member,reader Aug 26 16:05:14.494672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/e8bfb4199b0d4a57933fe1b685aa01cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/e8bfb4199b0d4a57933fe1b685aa01cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/e8bfb4199b0d4a57933fe1b685aa01cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_e8bfb4199b0d4a57933fe1b685aa01cd", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:05:14.494672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant: tempest-AttachVolumeShelveTestJSON-752766866 Aug 26 16:05:14.494672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Id: e8bfb4199b0d4a57933fe1b685aa01cd Aug 26 16:05:14.494672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-752766866 Aug 26 16:05:14.494672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User: tempest-AttachVolumeShelveTestJSON-752766866-project Aug 26 16:05:14.494672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Id: default Aug 26 16:05:14.494672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Name: Default Aug 26 16:05:14.494672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Id: 228837054cd648acb0df93dd423e1d83 Aug 26 16:05:14.494672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Name: tempest-AttachVolumeShelveTestJSON-752766866-project Aug 26 16:05:14.494672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: method: > Aug 26 16:05:14.494672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: exception: Instance 8ac977a7-aa08-459a-a863-36ba667422d1 could not be found. Aug 26 16:05:14.494672 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: action_args: {'id': '8ac977a7-aa08-459a-a863-36ba667422d1'} Aug 26 16:05:14.499271 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:05:14.499271 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:14.499271 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:05:14.499271 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:05:14.499271 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:05:14.499271 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:05:14.499271 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:05:14.499271 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:05:14.499271 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:05:14.499271 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:05:14.499271 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ac977a7-aa08-459a-a863-36ba667422d1 could not be found. Aug 26 16:05:14.499271 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:14.499271 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:05:14.499271 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:14.499271 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:14.499271 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:05:14.499271 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:05:14.499271 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:05:14.499271 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:05:14.499271 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:05:14.500819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:05:14.500819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 16:05:14.500819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 16:05:14.500819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 16:05:14.500819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 16:05:14.500819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:05:14.500819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:05:14.500819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:05:14.500819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:05:14.500819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ac977a7-aa08-459a-a863-36ba667422d1 could not be found. Aug 26 16:05:14.500819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:14.500819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:05:14.500819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:14.500819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:14.500819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:05:14.500819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:05:14.500819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:05:14.500819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:05:14.500819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ac977a7-aa08-459a-a863-36ba667422d1 could not be found. Aug 26 16:05:14.500819 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:14.502300 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-0c649d84-5acc-4235-8613-d214b03f24e2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Returning 404 to user: Instance 8ac977a7-aa08-459a-a863-36ba667422d1 could not be found. {{(pid=128305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:05:14.502300 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-0c649d84-5acc-4235-8613-d214b03f24e2 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "DELETE /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 404 len: 111 microversion: 2.20 time: 0.032255 Aug 26 16:05:14.502300 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 610/1210] 10.222.0.94 () {60 vars in 1280 bytes} [Fri Aug 26 16:05:14 2022] DELETE /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 16:05:14.505620 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-397d6112-8bc6-4a27-8900-615f9b018ae7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:14.506345 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-397d6112-8bc6-4a27-8900-615f9b018ae7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] [instance: 8ac977a7-aa08-459a-a863-36ba667422d1] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:14.512224 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-397d6112-8bc6-4a27-8900-615f9b018ae7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:14.512791 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-397d6112-8bc6-4a27-8900-615f9b018ae7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:14.514029 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-397d6112-8bc6-4a27-8900-615f9b018ae7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:14.514899 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-397d6112-8bc6-4a27-8900-615f9b018ae7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:14.515441 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-397d6112-8bc6-4a27-8900-615f9b018ae7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:14.515936 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-397d6112-8bc6-4a27-8900-615f9b018ae7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:14.531974 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.wsgi [None req-397d6112-8bc6-4a27-8900-615f9b018ae7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] HTTP exception thrown: Instance 8ac977a7-aa08-459a-a863-36ba667422d1 could not be found. Aug 26 16:05:14.533612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-397d6112-8bc6-4a27-8900-615f9b018ae7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Request method failure captured: Aug 26 16:05:14.533612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: request: GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 HTTP/1.1 Aug 26 16:05:14.533612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept: application/json Aug 26 16:05:14.533612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept-Encoding: identity Aug 26 16:05:14.533612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Connection: close Aug 26 16:05:14.533612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Length: 0 Aug 26 16:05:14.533612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Type: application/json Aug 26 16:05:14.533612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Host: 10.222.0.94 Aug 26 16:05:14.533612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Openstack-System-Scope: None Aug 26 16:05:14.533612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: User-Agent: python-urllib3/1.26.11 Aug 26 16:05:14.533612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Auth-Token: gAAAAABjCO1F1UfIrbIIIqx800DhgBQ_xLKUPQNDExaayaNWSrORPZqmlaNEr9-HCq5faaWsVbGXZxapKHPq-pZ9plOFRfzz3LDwvmt0IPrL8R0nR1c0gI7mXph447z8r464fSPa-J2FQWiNavpaQfTuChWNsILpXatKerRG5u9XFwxbJRh2x3U Aug 26 16:05:14.533612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Id: None Aug 26 16:05:14.533612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Name: None Aug 26 16:05:14.533612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Identity-Status: Confirmed Aug 26 16:05:14.533612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Is-Admin-Project: True Aug 26 16:05:14.533612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 16:05:14.533612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Id: default Aug 26 16:05:14.533612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Name: Default Aug 26 16:05:14.533612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Id: e8bfb4199b0d4a57933fe1b685aa01cd Aug 26 16:05:14.533612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-752766866 Aug 26 16:05:14.533612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Role: member,reader Aug 26 16:05:14.533612 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Roles: member,reader Aug 26 16:05:14.535441 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/e8bfb4199b0d4a57933fe1b685aa01cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/e8bfb4199b0d4a57933fe1b685aa01cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/e8bfb4199b0d4a57933fe1b685aa01cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_e8bfb4199b0d4a57933fe1b685aa01cd", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:05:14.535441 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant: tempest-AttachVolumeShelveTestJSON-752766866 Aug 26 16:05:14.535441 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Id: e8bfb4199b0d4a57933fe1b685aa01cd Aug 26 16:05:14.535441 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-752766866 Aug 26 16:05:14.535441 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User: tempest-AttachVolumeShelveTestJSON-752766866-project Aug 26 16:05:14.535441 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Id: default Aug 26 16:05:14.535441 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Name: Default Aug 26 16:05:14.535441 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Id: 228837054cd648acb0df93dd423e1d83 Aug 26 16:05:14.535441 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Name: tempest-AttachVolumeShelveTestJSON-752766866-project Aug 26 16:05:14.535441 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: method: > Aug 26 16:05:14.535441 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: exception: Instance 8ac977a7-aa08-459a-a863-36ba667422d1 could not be found. Aug 26 16:05:14.535441 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: action_args: {'id': '8ac977a7-aa08-459a-a863-36ba667422d1'} Aug 26 16:05:14.536356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:05:14.536356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:14.536356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:05:14.536356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:05:14.536356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:05:14.536356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:05:14.536356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:05:14.536356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:05:14.536356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:05:14.536356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:05:14.536356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ac977a7-aa08-459a-a863-36ba667422d1 could not be found. Aug 26 16:05:14.536356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:14.536356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:05:14.536356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:14.536356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:14.536356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:05:14.536356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:05:14.536356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:05:14.536356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:05:14.536356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:05:14.537841 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:05:14.537841 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:05:14.537841 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:05:14.537841 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:05:14.537841 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:05:14.537841 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:05:14.537841 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:05:14.537841 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ac977a7-aa08-459a-a863-36ba667422d1 could not be found. Aug 26 16:05:14.537841 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:14.537841 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:05:14.537841 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:14.537841 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:14.537841 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:05:14.537841 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:05:14.537841 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:05:14.537841 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:05:14.537841 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ac977a7-aa08-459a-a863-36ba667422d1 could not be found. Aug 26 16:05:14.537841 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:14.539324 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-397d6112-8bc6-4a27-8900-615f9b018ae7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] Returning 404 to user: Instance 8ac977a7-aa08-459a-a863-36ba667422d1 could not be found. {{(pid=128305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:05:14.539324 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-397d6112-8bc6-4a27-8900-615f9b018ae7 tempest-AttachVolumeShelveTestJSON-752766866 tempest-AttachVolumeShelveTestJSON-752766866-project] 10.222.0.94 "GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1" status: 404 len: 111 microversion: 2.20 time: 0.035470 Aug 26 16:05:14.539324 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 611/1211] 10.222.0.94 () {60 vars in 1277 bytes} [Fri Aug 26 16:05:14 2022] GET /compute/v2.1/servers/8ac977a7-aa08-459a-a863-36ba667422d1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 16:05:14.640189 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7facac2c-d16d-4adc-9aff-e592b9eb17d5 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:14.648054 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-7facac2c-d16d-4adc-9aff-e592b9eb17d5 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1576 microversion: 2.1 time: 0.183575 Aug 26 16:05:14.648622 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 601/1212] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:14 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:15.669552 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-f8f75bf3-0ebd-4391-a801-9e16654d3344 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:15.670322 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-f8f75bf3-0ebd-4391-a801-9e16654d3344 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:15.676946 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f8f75bf3-0ebd-4391-a801-9e16654d3344 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:15.677505 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f8f75bf3-0ebd-4391-a801-9e16654d3344 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:15.677953 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f8f75bf3-0ebd-4391-a801-9e16654d3344 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:15.678644 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f8f75bf3-0ebd-4391-a801-9e16654d3344 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:15.679128 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f8f75bf3-0ebd-4391-a801-9e16654d3344 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:15.679548 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f8f75bf3-0ebd-4391-a801-9e16654d3344 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:15.820968 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-f8f75bf3-0ebd-4391-a801-9e16654d3344 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:15.828883 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-f8f75bf3-0ebd-4391-a801-9e16654d3344 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1576 microversion: 2.1 time: 0.163872 Aug 26 16:05:15.829448 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 612/1213] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:15 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:16.850496 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-0e59192a-e6b4-4717-86f7-7f06a31cddff tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:16.852903 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-0e59192a-e6b4-4717-86f7-7f06a31cddff tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:16.864251 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0e59192a-e6b4-4717-86f7-7f06a31cddff tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:16.864819 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0e59192a-e6b4-4717-86f7-7f06a31cddff tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:16.865325 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0e59192a-e6b4-4717-86f7-7f06a31cddff tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:16.866106 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0e59192a-e6b4-4717-86f7-7f06a31cddff tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:16.866633 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0e59192a-e6b4-4717-86f7-7f06a31cddff tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:16.867157 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-0e59192a-e6b4-4717-86f7-7f06a31cddff tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:17.025771 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-0e59192a-e6b4-4717-86f7-7f06a31cddff tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:17.039412 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-0e59192a-e6b4-4717-86f7-7f06a31cddff tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1576 microversion: 2.1 time: 0.193444 Aug 26 16:05:17.040002 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 602/1214] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:16 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1576 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:18.067640 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-f41ea2b6-7f79-40c0-bf37-342550bdc487 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:18.103693 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-f41ea2b6-7f79-40c0-bf37-342550bdc487 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:18.103693 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f41ea2b6-7f79-40c0-bf37-342550bdc487 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:18.103693 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f41ea2b6-7f79-40c0-bf37-342550bdc487 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:18.103693 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f41ea2b6-7f79-40c0-bf37-342550bdc487 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:18.105295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f41ea2b6-7f79-40c0-bf37-342550bdc487 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:18.105295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f41ea2b6-7f79-40c0-bf37-342550bdc487 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:18.105295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f41ea2b6-7f79-40c0-bf37-342550bdc487 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:18.105295 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=100 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:05:18.309139 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-f41ea2b6-7f79-40c0-bf37-342550bdc487 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:18.317466 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-f41ea2b6-7f79-40c0-bf37-342550bdc487 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1576 microversion: 2.1 time: 0.255134 Aug 26 16:05:18.318042 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 613/1215] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:18 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1576 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:05:19.338500 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-3ae7aab1-5b2c-45d2-9aa5-e264f0c71ce0 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:19.339143 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-3ae7aab1-5b2c-45d2-9aa5-e264f0c71ce0 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:19.345764 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3ae7aab1-5b2c-45d2-9aa5-e264f0c71ce0 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:19.346256 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3ae7aab1-5b2c-45d2-9aa5-e264f0c71ce0 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:19.346710 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3ae7aab1-5b2c-45d2-9aa5-e264f0c71ce0 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:19.347511 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3ae7aab1-5b2c-45d2-9aa5-e264f0c71ce0 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:19.347977 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3ae7aab1-5b2c-45d2-9aa5-e264f0c71ce0 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:19.348583 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-3ae7aab1-5b2c-45d2-9aa5-e264f0c71ce0 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:19.485057 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-3ae7aab1-5b2c-45d2-9aa5-e264f0c71ce0 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:19.492788 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-3ae7aab1-5b2c-45d2-9aa5-e264f0c71ce0 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1576 microversion: 2.1 time: 0.158188 Aug 26 16:05:19.493351 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 603/1216] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:19 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:20.514670 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-5ca66a95-8d47-4d0e-8b31-ed5ec15dd7c1 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:20.515389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-5ca66a95-8d47-4d0e-8b31-ed5ec15dd7c1 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:20.521899 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5ca66a95-8d47-4d0e-8b31-ed5ec15dd7c1 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:20.522366 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5ca66a95-8d47-4d0e-8b31-ed5ec15dd7c1 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:20.522790 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5ca66a95-8d47-4d0e-8b31-ed5ec15dd7c1 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:20.523502 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5ca66a95-8d47-4d0e-8b31-ed5ec15dd7c1 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:20.523945 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5ca66a95-8d47-4d0e-8b31-ed5ec15dd7c1 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:20.524361 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5ca66a95-8d47-4d0e-8b31-ed5ec15dd7c1 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:20.666449 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-5ca66a95-8d47-4d0e-8b31-ed5ec15dd7c1 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:20.675144 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-5ca66a95-8d47-4d0e-8b31-ed5ec15dd7c1 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1576 microversion: 2.1 time: 0.164703 Aug 26 16:05:20.675710 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 614/1217] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:20 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:20.795827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7efb03fc-0ead-4533-8245-ec8ad13b2888 tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] Action: 'create', calling method: .version_select at 0x7f15d9496c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1121978460", "metadata": {"Type": "work"}}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:05:20.813560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7efb03fc-0ead-4533-8245-ec8ad13b2888 tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] Request method failure captured: Aug 26 16:05:20.813560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 26 16:05:20.813560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 16:05:20.813560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 16:05:20.813560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 16:05:20.813560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 122 Aug 26 16:05:20.813560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 16:05:20.813560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 16:05:20.813560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 16:05:20.813560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 16:05:20.813560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO9Alrk9Et4WPjZLJj68s58Xd-bZo55u4qzjveyYJICWKjLx9jpqlSgegiBpb5XW6AW2HFP6CJaXWoBzvQjNdtL-__6WrB5NfyqB0OHkitPXVRf4fbNJfeM7cowjKvyJAFbUTXU-2OgRlKtjQ7ugRtbIpPLYySYWJ-X0JMSUVKSOaKQ Aug 26 16:05:20.813560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 16:05:20.813560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 16:05:20.813560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 16:05:20.813560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 16:05:20.813560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 16:05:20.813560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 16:05:20.813560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: cbf13aeb88f04e42af5e50a95d30d717 Aug 26 16:05:20.813560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-VolumesNegativeTest-1536373382 Aug 26 16:05:20.813560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 16:05:20.813560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 16:05:20.815656 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/cbf13aeb88f04e42af5e50a95d30d717"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/cbf13aeb88f04e42af5e50a95d30d717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/cbf13aeb88f04e42af5e50a95d30d717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_cbf13aeb88f04e42af5e50a95d30d717", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:05:20.815656 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-VolumesNegativeTest-1536373382 Aug 26 16:05:20.815656 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: cbf13aeb88f04e42af5e50a95d30d717 Aug 26 16:05:20.815656 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-VolumesNegativeTest-1536373382 Aug 26 16:05:20.815656 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-VolumesNegativeTest-1536373382-project Aug 26 16:05:20.815656 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 16:05:20.815656 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 16:05:20.815656 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: 192d31bb52124ac5bcd11feda094590f Aug 26 16:05:20.815656 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-VolumesNegativeTest-1536373382-project Aug 26 16:05:20.815656 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Aug 26 16:05:20.815656 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1121978460", "metadata": {"Type": "work"}}} Aug 26 16:05:20.815656 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: Aug 26 16:05:20.815656 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 26 16:05:20.816731 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1121978460', 'metadata': {'Type': 'work'}}}} Aug 26 16:05:20.816731 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:05:20.816731 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:20.816731 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 26 16:05:20.816731 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 26 16:05:20.816731 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 26 16:05:20.816731 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise error Aug 26 16:05:20.816731 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 26 16:05:20.816731 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.816731 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 26 16:05:20.816731 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 26 16:05:20.816731 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.816731 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 26 16:05:20.816731 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi '#$%' Aug 26 16:05:20.816731 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.816731 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:05:20.816731 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.816731 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:20.816731 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:05:20.816731 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:05:20.816731 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:05:20.816731 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:05:20.818457 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 16:05:20.818457 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 16:05:20.818457 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:05:20.818457 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:05:20.818457 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 26 16:05:20.818457 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 26 16:05:20.818457 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 26 16:05:20.818457 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 26 16:05:20.818457 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 26 16:05:20.818457 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 26 16:05:20.818457 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 26 16:05:20.818457 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.818457 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:05:20.818457 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.818457 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:20.818457 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:05:20.818457 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:05:20.818457 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 26 16:05:20.818457 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 26 16:05:20.819858 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 26 16:05:20.819858 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.819858 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7efb03fc-0ead-4533-8245-ec8ad13b2888 tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:05:20.819858 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-7efb03fc-0ead-4533-8245-ec8ad13b2888 tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] 10.222.0.94 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.140139 Aug 26 16:05:20.819858 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 604/1218] 10.222.0.94 () {60 vars in 1156 bytes} [Fri Aug 26 16:05:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 26 16:05:20.826177 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a6a5ac65-522f-40c6-bc3e-372f06b85890 tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] Action: 'create', calling method: .version_select at 0x7f15d97badc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1332281156", "metadata": {"Type": "work"}}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:05:20.830834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a6a5ac65-522f-40c6-bc3e-372f06b85890 tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] Request method failure captured: Aug 26 16:05:20.830834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 26 16:05:20.830834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept: application/json Aug 26 16:05:20.830834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept-Encoding: identity Aug 26 16:05:20.830834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Connection: close Aug 26 16:05:20.830834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Length: 120 Aug 26 16:05:20.830834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Type: application/json Aug 26 16:05:20.830834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Host: 10.222.0.94 Aug 26 16:05:20.830834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Openstack-System-Scope: None Aug 26 16:05:20.830834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: User-Agent: python-urllib3/1.26.11 Aug 26 16:05:20.830834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Auth-Token: gAAAAABjCO9Alrk9Et4WPjZLJj68s58Xd-bZo55u4qzjveyYJICWKjLx9jpqlSgegiBpb5XW6AW2HFP6CJaXWoBzvQjNdtL-__6WrB5NfyqB0OHkitPXVRf4fbNJfeM7cowjKvyJAFbUTXU-2OgRlKtjQ7ugRtbIpPLYySYWJ-X0JMSUVKSOaKQ Aug 26 16:05:20.830834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Id: None Aug 26 16:05:20.830834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Name: None Aug 26 16:05:20.830834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Identity-Status: Confirmed Aug 26 16:05:20.830834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Is-Admin-Project: True Aug 26 16:05:20.830834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Id: default Aug 26 16:05:20.830834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Name: Default Aug 26 16:05:20.830834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Id: cbf13aeb88f04e42af5e50a95d30d717 Aug 26 16:05:20.830834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Name: tempest-VolumesNegativeTest-1536373382 Aug 26 16:05:20.830834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Role: member,reader Aug 26 16:05:20.830834 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Roles: member,reader Aug 26 16:05:20.832447 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/cbf13aeb88f04e42af5e50a95d30d717"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/cbf13aeb88f04e42af5e50a95d30d717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/cbf13aeb88f04e42af5e50a95d30d717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_cbf13aeb88f04e42af5e50a95d30d717", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:05:20.832447 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant: tempest-VolumesNegativeTest-1536373382 Aug 26 16:05:20.832447 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Id: cbf13aeb88f04e42af5e50a95d30d717 Aug 26 16:05:20.832447 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Name: tempest-VolumesNegativeTest-1536373382 Aug 26 16:05:20.832447 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User: tempest-VolumesNegativeTest-1536373382-project Aug 26 16:05:20.832447 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Id: default Aug 26 16:05:20.832447 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Name: Default Aug 26 16:05:20.832447 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Id: 192d31bb52124ac5bcd11feda094590f Aug 26 16:05:20.832447 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Name: tempest-VolumesNegativeTest-1536373382-project Aug 26 16:05:20.832447 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Aug 26 16:05:20.832447 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1332281156", "metadata": {"Type": "work"}}} Aug 26 16:05:20.832447 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: method: Aug 26 16:05:20.832447 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 26 16:05:20.833535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1332281156', 'metadata': {'Type': 'work'}}}} Aug 26 16:05:20.833535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:05:20.833535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:20.833535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 26 16:05:20.833535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 26 16:05:20.833535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 26 16:05:20.833535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise error Aug 26 16:05:20.833535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 26 16:05:20.833535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.833535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 26 16:05:20.833535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 26 16:05:20.833535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.833535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 26 16:05:20.833535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi '0' Aug 26 16:05:20.833535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.833535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:05:20.833535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.833535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:20.833535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:05:20.833535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:05:20.833535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:05:20.833535 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:05:20.835302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 16:05:20.835302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 16:05:20.835302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:05:20.835302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:05:20.835302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 26 16:05:20.835302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 26 16:05:20.835302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 26 16:05:20.835302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 26 16:05:20.835302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 26 16:05:20.835302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 26 16:05:20.835302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 26 16:05:20.835302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.835302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:05:20.835302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.835302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:20.835302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:05:20.835302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:05:20.835302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 26 16:05:20.835302 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 26 16:05:20.836520 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 26 16:05:20.836520 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.836520 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a6a5ac65-522f-40c6-bc3e-372f06b85890 tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:05:20.836520 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a6a5ac65-522f-40c6-bc3e-372f06b85890 tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] 10.222.0.94 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010247 Aug 26 16:05:20.836520 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 615/1219] 10.222.0.94 () {60 vars in 1156 bytes} [Fri Aug 26 16:05:20 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 16:05:20.841597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-940500f1-962c-427e-9fba-df46fb4565f5 tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] Action: 'create', calling method: .version_select at 0x7f15d9834160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2060221039", "metadata": {"Type": "work"}}} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:05:20.845258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-940500f1-962c-427e-9fba-df46fb4565f5 tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] Request method failure captured: Aug 26 16:05:20.845258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 26 16:05:20.845258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 16:05:20.845258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 16:05:20.845258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 16:05:20.845258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 119 Aug 26 16:05:20.845258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 16:05:20.845258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 16:05:20.845258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 16:05:20.845258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 16:05:20.845258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO9Alrk9Et4WPjZLJj68s58Xd-bZo55u4qzjveyYJICWKjLx9jpqlSgegiBpb5XW6AW2HFP6CJaXWoBzvQjNdtL-__6WrB5NfyqB0OHkitPXVRf4fbNJfeM7cowjKvyJAFbUTXU-2OgRlKtjQ7ugRtbIpPLYySYWJ-X0JMSUVKSOaKQ Aug 26 16:05:20.845258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 16:05:20.845258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 16:05:20.845258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 16:05:20.845258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 16:05:20.845258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 16:05:20.845258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 16:05:20.845258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: cbf13aeb88f04e42af5e50a95d30d717 Aug 26 16:05:20.845258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-VolumesNegativeTest-1536373382 Aug 26 16:05:20.845258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 16:05:20.845258 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 16:05:20.846807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/cbf13aeb88f04e42af5e50a95d30d717"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/cbf13aeb88f04e42af5e50a95d30d717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/cbf13aeb88f04e42af5e50a95d30d717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_cbf13aeb88f04e42af5e50a95d30d717", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:05:20.846807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-VolumesNegativeTest-1536373382 Aug 26 16:05:20.846807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: cbf13aeb88f04e42af5e50a95d30d717 Aug 26 16:05:20.846807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-VolumesNegativeTest-1536373382 Aug 26 16:05:20.846807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-VolumesNegativeTest-1536373382-project Aug 26 16:05:20.846807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 16:05:20.846807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 16:05:20.846807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: 192d31bb52124ac5bcd11feda094590f Aug 26 16:05:20.846807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-VolumesNegativeTest-1536373382-project Aug 26 16:05:20.846807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Aug 26 16:05:20.846807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2060221039", "metadata": {"Type": "work"}}} Aug 26 16:05:20.846807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: Aug 26 16:05:20.846807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 26 16:05:20.847738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2060221039', 'metadata': {'Type': 'work'}}}} Aug 26 16:05:20.847738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:05:20.847738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:20.847738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 26 16:05:20.847738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 26 16:05:20.847738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 26 16:05:20.847738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise error Aug 26 16:05:20.847738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 26 16:05:20.847738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.847738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 26 16:05:20.847738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 26 16:05:20.847738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.847738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 26 16:05:20.847738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi '' Aug 26 16:05:20.847738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.847738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:05:20.847738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.847738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:20.847738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:05:20.847738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:05:20.847738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:05:20.847738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:05:20.849346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 16:05:20.849346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 16:05:20.849346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:05:20.849346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:05:20.849346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 26 16:05:20.849346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 26 16:05:20.849346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 26 16:05:20.849346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 26 16:05:20.849346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 26 16:05:20.849346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 26 16:05:20.849346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 26 16:05:20.849346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.849346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:05:20.849346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.849346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:20.849346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:05:20.849346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:05:20.849346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 26 16:05:20.849346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 26 16:05:20.850624 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 26 16:05:20.850624 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.850624 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-940500f1-962c-427e-9fba-df46fb4565f5 tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:05:20.850624 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-940500f1-962c-427e-9fba-df46fb4565f5 tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] 10.222.0.94 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009301 Aug 26 16:05:20.850624 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 605/1220] 10.222.0.94 () {60 vars in 1156 bytes} [Fri Aug 26 16:05:20 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 26 16:05:20.856483 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-67959ae3-f723-44e2-a7f0-be1918fe39ef tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] Calling method '.version_select at 0x7f15d974ae50>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:20.885438 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.wsgi [None req-67959ae3-f723-44e2-a7f0-be1918fe39ef tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] HTTP exception thrown: Volume tempest-invalid-232238704 could not be found. Aug 26 16:05:20.889177 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-67959ae3-f723-44e2-a7f0-be1918fe39ef tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] Request method failure captured: Aug 26 16:05:20.889177 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-232238704 HTTP/1.1 Aug 26 16:05:20.889177 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept: application/json Aug 26 16:05:20.889177 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept-Encoding: identity Aug 26 16:05:20.889177 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Connection: close Aug 26 16:05:20.889177 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Length: 0 Aug 26 16:05:20.889177 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Type: application/json Aug 26 16:05:20.889177 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Host: 10.222.0.94 Aug 26 16:05:20.889177 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Openstack-System-Scope: None Aug 26 16:05:20.889177 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: User-Agent: python-urllib3/1.26.11 Aug 26 16:05:20.889177 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Auth-Token: gAAAAABjCO9Alrk9Et4WPjZLJj68s58Xd-bZo55u4qzjveyYJICWKjLx9jpqlSgegiBpb5XW6AW2HFP6CJaXWoBzvQjNdtL-__6WrB5NfyqB0OHkitPXVRf4fbNJfeM7cowjKvyJAFbUTXU-2OgRlKtjQ7ugRtbIpPLYySYWJ-X0JMSUVKSOaKQ Aug 26 16:05:20.889177 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Id: None Aug 26 16:05:20.889177 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Name: None Aug 26 16:05:20.889177 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Identity-Status: Confirmed Aug 26 16:05:20.889177 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Is-Admin-Project: True Aug 26 16:05:20.889177 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Id: default Aug 26 16:05:20.889177 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Name: Default Aug 26 16:05:20.889177 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Id: cbf13aeb88f04e42af5e50a95d30d717 Aug 26 16:05:20.889177 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Name: tempest-VolumesNegativeTest-1536373382 Aug 26 16:05:20.889177 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Role: member,reader Aug 26 16:05:20.889177 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Roles: member,reader Aug 26 16:05:20.890822 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/cbf13aeb88f04e42af5e50a95d30d717"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/cbf13aeb88f04e42af5e50a95d30d717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/cbf13aeb88f04e42af5e50a95d30d717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_cbf13aeb88f04e42af5e50a95d30d717", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:05:20.890822 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant: tempest-VolumesNegativeTest-1536373382 Aug 26 16:05:20.890822 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Id: cbf13aeb88f04e42af5e50a95d30d717 Aug 26 16:05:20.890822 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Name: tempest-VolumesNegativeTest-1536373382 Aug 26 16:05:20.890822 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User: tempest-VolumesNegativeTest-1536373382-project Aug 26 16:05:20.890822 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Id: default Aug 26 16:05:20.890822 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Name: Default Aug 26 16:05:20.890822 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Id: 192d31bb52124ac5bcd11feda094590f Aug 26 16:05:20.890822 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Name: tempest-VolumesNegativeTest-1536373382-project Aug 26 16:05:20.890822 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: method: Aug 26 16:05:20.890822 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: exception: Volume tempest-invalid-232238704 could not be found. Aug 26 16:05:20.890822 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: action_args: {'id': 'tempest-invalid-232238704'} Aug 26 16:05:20.890822 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:05:20.891861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:20.891861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 16:05:20.891861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 16:05:20.891861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 16:05:20.891861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 16:05:20.891861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 16:05:20.891861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 16:05:20.891861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 16:05:20.891861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 16:05:20.891861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 16:05:20.891861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 16:05:20.891861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 16:05:20.891861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 16:05:20.891861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 16:05:20.891861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 16:05:20.891861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-232238704 could not be found. (HTTP 404) (Request-ID: req-78ab7e1c-60de-498c-8c62-f9bd247b991e) Aug 26 16:05:20.891861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.891861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:05:20.891861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.893375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:20.893375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 26 16:05:20.893375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 26 16:05:20.893375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 16:05:20.893375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 16:05:20.893375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 16:05:20.893375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 16:05:20.893375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 16:05:20.893375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 16:05:20.893375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 16:05:20.893375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 16:05:20.893375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 16:05:20.893375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 16:05:20.893375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 16:05:20.893375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 16:05:20.893375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 16:05:20.893375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 16:05:20.893375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 16:05:20.893375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 16:05:20.894627 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 16:05:20.894627 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 16:05:20.894627 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 16:05:20.894627 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 16:05:20.894627 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-232238704 could not be found. Aug 26 16:05:20.894627 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.894627 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:05:20.894627 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.894627 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:20.894627 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:05:20.894627 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:05:20.894627 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:05:20.894627 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:05:20.894627 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 16:05:20.894627 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 16:05:20.894627 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:05:20.894627 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:05:20.894627 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 26 16:05:20.894627 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:05:20.894627 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-232238704 could not be found. Aug 26 16:05:20.895996 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.895996 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:05:20.895996 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.895996 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:20.895996 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:05:20.895996 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:05:20.895996 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:05:20.895996 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:05:20.895996 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-232238704 could not be found. Aug 26 16:05:20.895996 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.895996 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-67959ae3-f723-44e2-a7f0-be1918fe39ef tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] Returning 404 to user: Volume tempest-invalid-232238704 could not be found. {{(pid=128305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:05:20.895996 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-67959ae3-f723-44e2-a7f0-be1918fe39ef tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] 10.222.0.94 "DELETE /compute/v2.1/os-volumes/tempest-invalid-232238704" status: 404 len: 98 microversion: 2.1 time: 0.039484 Aug 26 16:05:20.895996 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 616/1221] 10.222.0.94 () {58 vars in 1215 bytes} [Fri Aug 26 16:05:20 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-232238704 => generated 98 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 26 16:05:20.905809 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-1357e5c4-c75e-4e7a-a815-ef58294e1fef tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] 10.222.0.94 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005316 Aug 26 16:05:20.906389 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 606/1222] 10.222.0.94 () {58 vars in 1140 bytes} [Fri Aug 26 16:05:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 26 16:05:20.915263 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-4cee2dfb-9d00-4c88-aea3-6f563d6c9fbf tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003939 Aug 26 16:05:20.915933 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 617/1223] 10.222.0.94 () {58 vars in 1137 bytes} [Fri Aug 26 16:05:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 26 16:05:20.925283 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-1e958414-97f6-4bee-825b-bd66d3c32520 tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] Calling method '.version_select at 0x7f15d9834d30>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:20.957965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-1e958414-97f6-4bee-825b-bd66d3c32520 tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] HTTP exception thrown: Volume 96ee4377-710b-49b3-a41d-cc0612abf603 could not be found. Aug 26 16:05:20.957965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-1e958414-97f6-4bee-825b-bd66d3c32520 tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] Request method failure captured: Aug 26 16:05:20.957965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: DELETE /compute/v2.1/os-volumes/96ee4377-710b-49b3-a41d-cc0612abf603 HTTP/1.1 Aug 26 16:05:20.957965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 16:05:20.957965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 16:05:20.957965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 16:05:20.957965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 0 Aug 26 16:05:20.957965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 16:05:20.957965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 16:05:20.957965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 16:05:20.957965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 16:05:20.957965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO9Alrk9Et4WPjZLJj68s58Xd-bZo55u4qzjveyYJICWKjLx9jpqlSgegiBpb5XW6AW2HFP6CJaXWoBzvQjNdtL-__6WrB5NfyqB0OHkitPXVRf4fbNJfeM7cowjKvyJAFbUTXU-2OgRlKtjQ7ugRtbIpPLYySYWJ-X0JMSUVKSOaKQ Aug 26 16:05:20.957965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 16:05:20.957965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 16:05:20.957965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 16:05:20.957965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 16:05:20.957965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 16:05:20.957965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 16:05:20.957965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: cbf13aeb88f04e42af5e50a95d30d717 Aug 26 16:05:20.957965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-VolumesNegativeTest-1536373382 Aug 26 16:05:20.957965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 16:05:20.957965 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 16:05:20.959719 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/cbf13aeb88f04e42af5e50a95d30d717"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/cbf13aeb88f04e42af5e50a95d30d717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/cbf13aeb88f04e42af5e50a95d30d717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_cbf13aeb88f04e42af5e50a95d30d717", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:05:20.959719 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-VolumesNegativeTest-1536373382 Aug 26 16:05:20.959719 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: cbf13aeb88f04e42af5e50a95d30d717 Aug 26 16:05:20.959719 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-VolumesNegativeTest-1536373382 Aug 26 16:05:20.959719 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-VolumesNegativeTest-1536373382-project Aug 26 16:05:20.959719 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 16:05:20.959719 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 16:05:20.959719 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: 192d31bb52124ac5bcd11feda094590f Aug 26 16:05:20.959719 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-VolumesNegativeTest-1536373382-project Aug 26 16:05:20.959719 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: Aug 26 16:05:20.959719 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Volume 96ee4377-710b-49b3-a41d-cc0612abf603 could not be found. Aug 26 16:05:20.959719 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'id': '96ee4377-710b-49b3-a41d-cc0612abf603'} Aug 26 16:05:20.959719 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:05:20.960575 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:20.960575 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 16:05:20.960575 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 16:05:20.960575 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 16:05:20.960575 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 16:05:20.960575 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 16:05:20.960575 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 16:05:20.960575 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 16:05:20.960575 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 16:05:20.960575 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 16:05:20.960575 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 16:05:20.960575 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 16:05:20.960575 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 16:05:20.960575 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 16:05:20.960575 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 16:05:20.960575 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 96ee4377-710b-49b3-a41d-cc0612abf603 could not be found. (HTTP 404) (Request-ID: req-4a453b0a-a7e5-432c-b5e8-2ff2296e744c) Aug 26 16:05:20.960575 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.960575 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:05:20.960575 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.961752 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:20.961752 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 26 16:05:20.961752 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 26 16:05:20.961752 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 16:05:20.961752 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 16:05:20.961752 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 16:05:20.961752 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 16:05:20.961752 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 16:05:20.961752 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 16:05:20.961752 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 16:05:20.961752 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 16:05:20.961752 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 16:05:20.961752 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 16:05:20.961752 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 16:05:20.961752 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 16:05:20.961752 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 16:05:20.961752 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 16:05:20.961752 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 16:05:20.961752 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 16:05:20.962984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 16:05:20.962984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 16:05:20.962984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 16:05:20.962984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 16:05:20.962984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 96ee4377-710b-49b3-a41d-cc0612abf603 could not be found. Aug 26 16:05:20.962984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.962984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:05:20.962984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.962984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:20.962984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:05:20.962984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:05:20.962984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:05:20.962984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:05:20.962984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 16:05:20.962984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 16:05:20.962984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:05:20.962984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:05:20.962984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 26 16:05:20.962984 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:05:20.964173 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 96ee4377-710b-49b3-a41d-cc0612abf603 could not be found. Aug 26 16:05:20.964173 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.964173 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:05:20.964173 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.964173 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:20.964173 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:05:20.964173 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:05:20.964173 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:05:20.964173 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:05:20.964173 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 96ee4377-710b-49b3-a41d-cc0612abf603 could not be found. Aug 26 16:05:20.964173 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:05:20.964173 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-1e958414-97f6-4bee-825b-bd66d3c32520 tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] Returning 404 to user: Volume 96ee4377-710b-49b3-a41d-cc0612abf603 could not be found. {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:05:20.964173 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-1e958414-97f6-4bee-825b-bd66d3c32520 tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] 10.222.0.94 "DELETE /compute/v2.1/os-volumes/96ee4377-710b-49b3-a41d-cc0612abf603" status: 404 len: 109 microversion: 2.1 time: 0.036695 Aug 26 16:05:20.964173 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 607/1224] 10.222.0.94 () {58 vars in 1248 bytes} [Fri Aug 26 16:05:20 2022] DELETE /compute/v2.1/os-volumes/96ee4377-710b-49b3-a41d-cc0612abf603 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:05:20.968649 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-327ef41f-4536-43ad-8f48-a2f3ae05b30e tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] Calling method '.version_select at 0x7f15d97ba4c0>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:20.996184 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.wsgi [None req-327ef41f-4536-43ad-8f48-a2f3ae05b30e tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] HTTP exception thrown: Volume d3af189c-174a-4581-9294-f9964c541d06 could not be found. Aug 26 16:05:20.998723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-327ef41f-4536-43ad-8f48-a2f3ae05b30e tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] Request method failure captured: Aug 26 16:05:20.998723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: request: GET /compute/v2.1/os-volumes/d3af189c-174a-4581-9294-f9964c541d06 HTTP/1.1 Aug 26 16:05:20.998723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept: application/json Aug 26 16:05:20.998723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept-Encoding: identity Aug 26 16:05:20.998723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Connection: close Aug 26 16:05:20.998723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Length: 0 Aug 26 16:05:20.998723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Type: application/json Aug 26 16:05:20.998723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Host: 10.222.0.94 Aug 26 16:05:20.998723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Openstack-System-Scope: None Aug 26 16:05:20.998723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: User-Agent: python-urllib3/1.26.11 Aug 26 16:05:20.998723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Auth-Token: gAAAAABjCO9Alrk9Et4WPjZLJj68s58Xd-bZo55u4qzjveyYJICWKjLx9jpqlSgegiBpb5XW6AW2HFP6CJaXWoBzvQjNdtL-__6WrB5NfyqB0OHkitPXVRf4fbNJfeM7cowjKvyJAFbUTXU-2OgRlKtjQ7ugRtbIpPLYySYWJ-X0JMSUVKSOaKQ Aug 26 16:05:20.998723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Id: None Aug 26 16:05:20.998723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Name: None Aug 26 16:05:20.998723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Identity-Status: Confirmed Aug 26 16:05:20.998723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Is-Admin-Project: True Aug 26 16:05:20.998723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Id: default Aug 26 16:05:20.998723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Name: Default Aug 26 16:05:20.998723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Id: cbf13aeb88f04e42af5e50a95d30d717 Aug 26 16:05:20.998723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Name: tempest-VolumesNegativeTest-1536373382 Aug 26 16:05:20.998723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Role: member,reader Aug 26 16:05:20.998723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Roles: member,reader Aug 26 16:05:21.000426 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/cbf13aeb88f04e42af5e50a95d30d717"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/cbf13aeb88f04e42af5e50a95d30d717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/cbf13aeb88f04e42af5e50a95d30d717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_cbf13aeb88f04e42af5e50a95d30d717", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:05:21.000426 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant: tempest-VolumesNegativeTest-1536373382 Aug 26 16:05:21.000426 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Id: cbf13aeb88f04e42af5e50a95d30d717 Aug 26 16:05:21.000426 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Name: tempest-VolumesNegativeTest-1536373382 Aug 26 16:05:21.000426 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User: tempest-VolumesNegativeTest-1536373382-project Aug 26 16:05:21.000426 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Id: default Aug 26 16:05:21.000426 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Name: Default Aug 26 16:05:21.000426 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Id: 192d31bb52124ac5bcd11feda094590f Aug 26 16:05:21.000426 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Name: tempest-VolumesNegativeTest-1536373382-project Aug 26 16:05:21.000426 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: method: Aug 26 16:05:21.000426 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: exception: Volume d3af189c-174a-4581-9294-f9964c541d06 could not be found. Aug 26 16:05:21.000426 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: action_args: {'id': 'd3af189c-174a-4581-9294-f9964c541d06'} Aug 26 16:05:21.000426 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:05:21.001366 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:21.001366 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 16:05:21.001366 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 16:05:21.001366 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 16:05:21.001366 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 16:05:21.001366 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 16:05:21.001366 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 16:05:21.001366 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 16:05:21.001366 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 16:05:21.001366 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 16:05:21.001366 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 16:05:21.001366 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 16:05:21.001366 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 16:05:21.001366 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 16:05:21.001366 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 16:05:21.001366 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d3af189c-174a-4581-9294-f9964c541d06 could not be found. (HTTP 404) (Request-ID: req-b0a3d90b-f6e0-4d9a-a155-b43fa786c475) Aug 26 16:05:21.001366 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:21.001366 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:05:21.001366 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:21.002596 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:21.002596 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 16:05:21.002596 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 16:05:21.002596 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 16:05:21.002596 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 16:05:21.002596 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 16:05:21.002596 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 16:05:21.002596 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 16:05:21.002596 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 16:05:21.002596 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 16:05:21.002596 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 16:05:21.002596 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 16:05:21.002596 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 16:05:21.002596 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 16:05:21.002596 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 16:05:21.002596 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 16:05:21.002596 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 16:05:21.002596 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 16:05:21.002596 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 16:05:21.003857 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 16:05:21.003857 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 16:05:21.003857 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 16:05:21.003857 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 16:05:21.003857 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d3af189c-174a-4581-9294-f9964c541d06 could not be found. Aug 26 16:05:21.003857 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:21.003857 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:05:21.003857 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:21.003857 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:21.003857 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:05:21.003857 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:05:21.003857 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:05:21.003857 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:05:21.003857 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 16:05:21.003857 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 16:05:21.003857 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:05:21.003857 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:05:21.003857 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 16:05:21.003857 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:05:21.005159 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d3af189c-174a-4581-9294-f9964c541d06 could not be found. Aug 26 16:05:21.005159 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:21.005159 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:05:21.005159 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:21.005159 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:05:21.005159 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:05:21.005159 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:05:21.005159 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:05:21.005159 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:05:21.005159 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d3af189c-174a-4581-9294-f9964c541d06 could not be found. Aug 26 16:05:21.005159 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:05:21.005159 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-327ef41f-4536-43ad-8f48-a2f3ae05b30e tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] Returning 404 to user: Volume d3af189c-174a-4581-9294-f9964c541d06 could not be found. {{(pid=128305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:05:21.005159 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-327ef41f-4536-43ad-8f48-a2f3ae05b30e tempest-VolumesNegativeTest-1536373382 tempest-VolumesNegativeTest-1536373382-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/d3af189c-174a-4581-9294-f9964c541d06" status: 404 len: 109 microversion: 2.1 time: 0.036185 Aug 26 16:05:21.005159 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 618/1225] 10.222.0.94 () {58 vars in 1245 bytes} [Fri Aug 26 16:05:20 2022] GET /compute/v2.1/os-volumes/d3af189c-174a-4581-9294-f9964c541d06 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:05:21.698443 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-41ccd626-e718-470d-860e-ec2b300f6c5f tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:21.699283 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-41ccd626-e718-470d-860e-ec2b300f6c5f tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:21.707634 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-41ccd626-e718-470d-860e-ec2b300f6c5f tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:21.708139 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-41ccd626-e718-470d-860e-ec2b300f6c5f tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:21.708610 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-41ccd626-e718-470d-860e-ec2b300f6c5f tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:21.709364 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-41ccd626-e718-470d-860e-ec2b300f6c5f tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:21.710401 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-41ccd626-e718-470d-860e-ec2b300f6c5f tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:21.710779 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-41ccd626-e718-470d-860e-ec2b300f6c5f tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:21.854507 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-41ccd626-e718-470d-860e-ec2b300f6c5f tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:21.863466 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-41ccd626-e718-470d-860e-ec2b300f6c5f tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1563 microversion: 2.1 time: 0.169292 Aug 26 16:05:21.864633 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 608/1226] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:21 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1563 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:30.111088 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-6474b0b9-a53e-4102-9336-bbb381eb2053 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-330019163", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1864094508", "security_groups": [{"name": "tempest-secgroup-smoke-641091027"}], "block_device_mapping_v2": [{"uuid": "238a9114-1331-489d-8dba-62e49cd4e45b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b0da63e8-a587-4953-adca-efb59d8c08a4"}]}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:05:30.224686 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.network.neutron [None req-6474b0b9-a53e-4102-9336-bbb381eb2053 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] validate_networks() for [('b0da63e8-a587-4953-adca-efb59d8c08a4', None, None, None, None, None)] {{(pid=128305) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 16:05:30.599998 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-6474b0b9-a53e-4102-9336-bbb381eb2053 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Flavor limits 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 16:05:30.600420 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-6474b0b9-a53e-4102-9336-bbb381eb2053 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Image limits 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 16:05:30.600886 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-6474b0b9-a53e-4102-9336-bbb381eb2053 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Flavor pref 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 16:05:30.601315 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-6474b0b9-a53e-4102-9336-bbb381eb2053 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Image pref 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 16:05:30.601717 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-6474b0b9-a53e-4102-9336-bbb381eb2053 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 16:05:30.610668 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6474b0b9-a53e-4102-9336-bbb381eb2053 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:30.611170 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6474b0b9-a53e-4102-9336-bbb381eb2053 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:30.611686 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6474b0b9-a53e-4102-9336-bbb381eb2053 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:30.612621 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6474b0b9-a53e-4102-9336-bbb381eb2053 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:30.613066 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6474b0b9-a53e-4102-9336-bbb381eb2053 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:30.613487 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-6474b0b9-a53e-4102-9336-bbb381eb2053 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:30.630596 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-6474b0b9-a53e-4102-9336-bbb381eb2053 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Getting quotas for project 3c5f0e0c02e64047b9ca17a7320b0bf5. Resources: {'instances', 'ram', 'cores'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 16:05:30.634723 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-6474b0b9-a53e-4102-9336-bbb381eb2053 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Getting quotas for user c911a9324cb744a6a1aeb068565d3f89 and project 3c5f0e0c02e64047b9ca17a7320b0bf5. Resources: {'instances', 'ram', 'cores'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 16:05:30.693000 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-6474b0b9-a53e-4102-9336-bbb381eb2053 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Going to run 1 instances... {{(pid=128305) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 16:05:30.695188 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-6474b0b9-a53e-4102-9336-bbb381eb2053 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='238a9114-1331-489d-8dba-62e49cd4e45b',volume_size=None,volume_type=None)] {{(pid=128305) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 16:05:31.206407 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-6474b0b9-a53e-4102-9336-bbb381eb2053 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.100650 Aug 26 16:05:31.207189 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 619/1227] 10.222.0.94 () {60 vars in 1147 bytes} [Fri Aug 26 16:05:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1102 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 16:05:31.217713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-cf6438a0-55b0-4603-8873-9330789d9065 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:31.218364 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-cf6438a0-55b0-4603-8873-9330789d9065 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:31.221607 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:05:31.274682 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-cf6438a0-55b0-4603-8873-9330789d9065 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:31.281591 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-cf6438a0-55b0-4603-8873-9330789d9065 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6" status: 200 len: 1094 microversion: 2.1 time: 0.067703 Aug 26 16:05:31.282805 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 609/1228] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:31 2022] GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:32.304505 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-e0032e61-19a0-46c9-82d8-8597928f4c1f tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:32.305213 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-e0032e61-19a0-46c9-82d8-8597928f4c1f tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:32.307212 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:05:32.359283 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-e0032e61-19a0-46c9-82d8-8597928f4c1f tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:32.366682 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-e0032e61-19a0-46c9-82d8-8597928f4c1f tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6" status: 200 len: 1094 microversion: 2.1 time: 0.066598 Aug 26 16:05:32.367300 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 620/1229] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:32 2022] GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:33.388264 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-621037f1-0865-453b-85c2-e62f22445d9b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:33.388883 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-621037f1-0865-453b-85c2-e62f22445d9b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:33.391076 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=62 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:05:33.397453 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-621037f1-0865-453b-85c2-e62f22445d9b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:33.397947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-621037f1-0865-453b-85c2-e62f22445d9b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:33.398393 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-621037f1-0865-453b-85c2-e62f22445d9b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:33.399115 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-621037f1-0865-453b-85c2-e62f22445d9b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:33.399575 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-621037f1-0865-453b-85c2-e62f22445d9b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:33.400003 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-621037f1-0865-453b-85c2-e62f22445d9b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:33.464104 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-621037f1-0865-453b-85c2-e62f22445d9b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:33.471767 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-621037f1-0865-453b-85c2-e62f22445d9b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6" status: 200 len: 1136 microversion: 2.1 time: 0.087460 Aug 26 16:05:33.477463 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 610/1230] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:33 2022] GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 => generated 1136 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:34.492820 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-074cf8c3-b75a-4c84-97bf-80976f7abdbc tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:34.493408 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-074cf8c3-b75a-4c84-97bf-80976f7abdbc tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:34.500485 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-074cf8c3-b75a-4c84-97bf-80976f7abdbc tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:34.500966 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-074cf8c3-b75a-4c84-97bf-80976f7abdbc tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:34.501402 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-074cf8c3-b75a-4c84-97bf-80976f7abdbc tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:34.502159 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-074cf8c3-b75a-4c84-97bf-80976f7abdbc tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:34.502648 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-074cf8c3-b75a-4c84-97bf-80976f7abdbc tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:34.503110 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-074cf8c3-b75a-4c84-97bf-80976f7abdbc tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:34.565625 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-074cf8c3-b75a-4c84-97bf-80976f7abdbc tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:34.573627 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-074cf8c3-b75a-4c84-97bf-80976f7abdbc tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6" status: 200 len: 1136 microversion: 2.1 time: 0.085252 Aug 26 16:05:34.574192 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 621/1231] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:34 2022] GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 => generated 1136 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:35.595018 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-817c3cb6-c5f5-40d2-9422-afc361bded64 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:35.595638 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-817c3cb6-c5f5-40d2-9422-afc361bded64 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:35.602839 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-817c3cb6-c5f5-40d2-9422-afc361bded64 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:35.603355 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-817c3cb6-c5f5-40d2-9422-afc361bded64 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:35.603799 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-817c3cb6-c5f5-40d2-9422-afc361bded64 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:35.604498 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-817c3cb6-c5f5-40d2-9422-afc361bded64 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:35.604958 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-817c3cb6-c5f5-40d2-9422-afc361bded64 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:35.605390 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-817c3cb6-c5f5-40d2-9422-afc361bded64 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:35.665541 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-817c3cb6-c5f5-40d2-9422-afc361bded64 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:35.673130 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-817c3cb6-c5f5-40d2-9422-afc361bded64 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6" status: 200 len: 1136 microversion: 2.1 time: 0.082633 Aug 26 16:05:35.673696 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 611/1232] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:35 2022] GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 => generated 1136 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:36.694677 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-4120f8ae-acab-49f6-832e-87190e5fa787 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:36.695786 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-4120f8ae-acab-49f6-832e-87190e5fa787 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:36.702711 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4120f8ae-acab-49f6-832e-87190e5fa787 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:36.703241 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4120f8ae-acab-49f6-832e-87190e5fa787 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:36.703697 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4120f8ae-acab-49f6-832e-87190e5fa787 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:36.704883 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4120f8ae-acab-49f6-832e-87190e5fa787 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:36.705342 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4120f8ae-acab-49f6-832e-87190e5fa787 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:36.705771 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4120f8ae-acab-49f6-832e-87190e5fa787 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:36.771082 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-4120f8ae-acab-49f6-832e-87190e5fa787 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:36.779235 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-4120f8ae-acab-49f6-832e-87190e5fa787 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6" status: 200 len: 1192 microversion: 2.1 time: 0.089254 Aug 26 16:05:36.779818 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 622/1233] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:36 2022] GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 => generated 1192 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:37.800315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-f73a9f3b-c600-475d-bb5c-f932e926d4df tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:37.800927 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-f73a9f3b-c600-475d-bb5c-f932e926d4df tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:37.807642 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f73a9f3b-c600-475d-bb5c-f932e926d4df tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:37.808129 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f73a9f3b-c600-475d-bb5c-f932e926d4df tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:37.808424 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f73a9f3b-c600-475d-bb5c-f932e926d4df tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:37.812366 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f73a9f3b-c600-475d-bb5c-f932e926d4df tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:37.812366 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f73a9f3b-c600-475d-bb5c-f932e926d4df tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:37.812366 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-f73a9f3b-c600-475d-bb5c-f932e926d4df tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:37.998342 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-f73a9f3b-c600-475d-bb5c-f932e926d4df tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:38.007201 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-f73a9f3b-c600-475d-bb5c-f932e926d4df tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6" status: 200 len: 1277 microversion: 2.1 time: 0.210098 Aug 26 16:05:38.008295 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 612/1234] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:37 2022] GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 => generated 1277 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:38.879579 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-11147230-ebfb-405c-9c2e-b2bd2d25eb5d req-c7f1ea06-218d-431c-bad1-3cb80137da46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "661129a9-294b-4425-ac84-500d92de2cc6", "tag": "eb277382-54d6-4a0a-8b01-2c0326eb53d2"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:05:38.892698 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-11147230-ebfb-405c-9c2e-b2bd2d25eb5d req-c7f1ea06-218d-431c-bad1-3cb80137da46 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:38.893286 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-11147230-ebfb-405c-9c2e-b2bd2d25eb5d req-c7f1ea06-218d-431c-bad1-3cb80137da46 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:38.893796 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-11147230-ebfb-405c-9c2e-b2bd2d25eb5d req-c7f1ea06-218d-431c-bad1-3cb80137da46 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:38.910940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-11147230-ebfb-405c-9c2e-b2bd2d25eb5d req-c7f1ea06-218d-431c-bad1-3cb80137da46 service nova] Creating event network-changed:eb277382-54d6-4a0a-8b01-2c0326eb53d2 for instance 661129a9-294b-4425-ac84-500d92de2cc6 on hv-cinder-85144 Aug 26 16:05:38.917429 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-11147230-ebfb-405c-9c2e-b2bd2d25eb5d req-c7f1ea06-218d-431c-bad1-3cb80137da46 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044882 Aug 26 16:05:38.918721 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 623/1235] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:05:39.030891 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-590c64bb-a93e-4f10-bbfe-dc7b0f8760c9 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:39.031600 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-590c64bb-a93e-4f10-bbfe-dc7b0f8760c9 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:39.041216 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-590c64bb-a93e-4f10-bbfe-dc7b0f8760c9 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:39.041716 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-590c64bb-a93e-4f10-bbfe-dc7b0f8760c9 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:39.042245 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-590c64bb-a93e-4f10-bbfe-dc7b0f8760c9 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:39.042987 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-590c64bb-a93e-4f10-bbfe-dc7b0f8760c9 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:39.043629 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-590c64bb-a93e-4f10-bbfe-dc7b0f8760c9 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:39.044062 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-590c64bb-a93e-4f10-bbfe-dc7b0f8760c9 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:39.231843 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-590c64bb-a93e-4f10-bbfe-dc7b0f8760c9 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:39.240400 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-590c64bb-a93e-4f10-bbfe-dc7b0f8760c9 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6" status: 200 len: 1277 microversion: 2.1 time: 0.214570 Aug 26 16:05:39.241602 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 613/1236] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:39 2022] GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 => generated 1277 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:40.266710 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-ae17998f-72ff-43d1-b810-edb940088a10 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:40.268276 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-ae17998f-72ff-43d1-b810-edb940088a10 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:40.275799 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ae17998f-72ff-43d1-b810-edb940088a10 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:40.276280 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ae17998f-72ff-43d1-b810-edb940088a10 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:40.276717 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ae17998f-72ff-43d1-b810-edb940088a10 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:40.278341 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ae17998f-72ff-43d1-b810-edb940088a10 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:40.278499 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ae17998f-72ff-43d1-b810-edb940088a10 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:40.278943 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ae17998f-72ff-43d1-b810-edb940088a10 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:40.423086 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-ae17998f-72ff-43d1-b810-edb940088a10 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:40.431928 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-ae17998f-72ff-43d1-b810-edb940088a10 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6" status: 200 len: 1265 microversion: 2.1 time: 0.173471 Aug 26 16:05:40.432495 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 624/1237] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:40 2022] GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:41.453845 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-b16e7346-3c84-47ad-8193-681adf00b6fc tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:41.454471 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-b16e7346-3c84-47ad-8193-681adf00b6fc tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:41.457399 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell0:SELECT=2 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:05:41.464180 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b16e7346-3c84-47ad-8193-681adf00b6fc tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:41.464180 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b16e7346-3c84-47ad-8193-681adf00b6fc tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:41.464180 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b16e7346-3c84-47ad-8193-681adf00b6fc tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:41.464180 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b16e7346-3c84-47ad-8193-681adf00b6fc tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:41.464717 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b16e7346-3c84-47ad-8193-681adf00b6fc tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:41.464717 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b16e7346-3c84-47ad-8193-681adf00b6fc tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:41.880645 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-b16e7346-3c84-47ad-8193-681adf00b6fc tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:41.890997 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-b16e7346-3c84-47ad-8193-681adf00b6fc tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6" status: 200 len: 1265 microversion: 2.1 time: 0.441133 Aug 26 16:05:41.891584 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 614/1238] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:41 2022] GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 => generated 1265 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:42.911051 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-092be28f-fe51-4388-8320-66f7532c9d65 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:42.911658 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-092be28f-fe51-4388-8320-66f7532c9d65 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:42.913901 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell0:SELECT=2 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:05:42.915114 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell0:SELECT=8 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:05:42.919916 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-092be28f-fe51-4388-8320-66f7532c9d65 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:42.920395 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-092be28f-fe51-4388-8320-66f7532c9d65 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:42.920831 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-092be28f-fe51-4388-8320-66f7532c9d65 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:42.921524 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-092be28f-fe51-4388-8320-66f7532c9d65 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:42.921967 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-092be28f-fe51-4388-8320-66f7532c9d65 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:42.922388 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-092be28f-fe51-4388-8320-66f7532c9d65 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:43.065223 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-092be28f-fe51-4388-8320-66f7532c9d65 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:43.074434 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-092be28f-fe51-4388-8320-66f7532c9d65 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6" status: 200 len: 1265 microversion: 2.1 time: 0.167193 Aug 26 16:05:43.095481 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 625/1239] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:42 2022] GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:44.097204 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-00370875-9a7a-4991-8e14-9d119e1a7621 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:44.097916 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-00370875-9a7a-4991-8e14-9d119e1a7621 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:44.106155 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-00370875-9a7a-4991-8e14-9d119e1a7621 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:44.106872 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-00370875-9a7a-4991-8e14-9d119e1a7621 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:44.107989 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-00370875-9a7a-4991-8e14-9d119e1a7621 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:44.110563 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-00370875-9a7a-4991-8e14-9d119e1a7621 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:44.110563 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-00370875-9a7a-4991-8e14-9d119e1a7621 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:44.110563 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-00370875-9a7a-4991-8e14-9d119e1a7621 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:44.260647 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-00370875-9a7a-4991-8e14-9d119e1a7621 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:44.269050 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-00370875-9a7a-4991-8e14-9d119e1a7621 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6" status: 200 len: 1265 microversion: 2.1 time: 0.175970 Aug 26 16:05:44.269848 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 615/1240] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:44 2022] GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:45.290667 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-309d9d57-5795-462b-8e61-92b57b12d810 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:45.291305 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-309d9d57-5795-462b-8e61-92b57b12d810 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:45.298726 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-309d9d57-5795-462b-8e61-92b57b12d810 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:45.299278 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-309d9d57-5795-462b-8e61-92b57b12d810 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:45.299722 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-309d9d57-5795-462b-8e61-92b57b12d810 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:45.300421 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-309d9d57-5795-462b-8e61-92b57b12d810 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:45.300873 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-309d9d57-5795-462b-8e61-92b57b12d810 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:45.301487 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-309d9d57-5795-462b-8e61-92b57b12d810 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:45.452038 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-309d9d57-5795-462b-8e61-92b57b12d810 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:45.460208 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-309d9d57-5795-462b-8e61-92b57b12d810 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6" status: 200 len: 1265 microversion: 2.1 time: 0.174476 Aug 26 16:05:45.464247 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 626/1241] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:45 2022] GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:46.484163 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-280aa906-2525-48c5-8488-d2a4e135a654 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:46.485513 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-280aa906-2525-48c5-8488-d2a4e135a654 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:46.496134 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-280aa906-2525-48c5-8488-d2a4e135a654 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:46.497104 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-280aa906-2525-48c5-8488-d2a4e135a654 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:46.497725 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-280aa906-2525-48c5-8488-d2a4e135a654 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:46.498721 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-280aa906-2525-48c5-8488-d2a4e135a654 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:46.499434 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-280aa906-2525-48c5-8488-d2a4e135a654 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:46.500283 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-280aa906-2525-48c5-8488-d2a4e135a654 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:46.653894 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-280aa906-2525-48c5-8488-d2a4e135a654 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:46.661806 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-280aa906-2525-48c5-8488-d2a4e135a654 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6" status: 200 len: 1265 microversion: 2.1 time: 0.182595 Aug 26 16:05:46.662374 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 616/1242] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:46 2022] GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:47.682356 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-5bc9ed36-437b-4d8c-a487-e9be80abd89a tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:47.682994 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-5bc9ed36-437b-4d8c-a487-e9be80abd89a tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:47.690040 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5bc9ed36-437b-4d8c-a487-e9be80abd89a tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:47.690523 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5bc9ed36-437b-4d8c-a487-e9be80abd89a tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:47.690980 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5bc9ed36-437b-4d8c-a487-e9be80abd89a tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:47.691680 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5bc9ed36-437b-4d8c-a487-e9be80abd89a tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:47.692141 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5bc9ed36-437b-4d8c-a487-e9be80abd89a tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:47.692567 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-5bc9ed36-437b-4d8c-a487-e9be80abd89a tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:47.831633 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-5bc9ed36-437b-4d8c-a487-e9be80abd89a tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:47.841082 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-5bc9ed36-437b-4d8c-a487-e9be80abd89a tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6" status: 200 len: 1265 microversion: 2.1 time: 0.162786 Aug 26 16:05:47.846966 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 627/1243] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:47 2022] GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:48.730702 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-721d97fe-efa9-424f-9950-910eaf642a44 req-8ac1f2d1-a6e6-4248-9b0f-b41feec5705e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "661129a9-294b-4425-ac84-500d92de2cc6", "name": "network-vif-plugged", "status": "completed", "tag": "eb277382-54d6-4a0a-8b01-2c0326eb53d2"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:05:48.741011 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-721d97fe-efa9-424f-9950-910eaf642a44 req-8ac1f2d1-a6e6-4248-9b0f-b41feec5705e service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:48.741499 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-721d97fe-efa9-424f-9950-910eaf642a44 req-8ac1f2d1-a6e6-4248-9b0f-b41feec5705e service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:48.742513 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-721d97fe-efa9-424f-9950-910eaf642a44 req-8ac1f2d1-a6e6-4248-9b0f-b41feec5705e service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:48.753894 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-721d97fe-efa9-424f-9950-910eaf642a44 req-8ac1f2d1-a6e6-4248-9b0f-b41feec5705e service nova] Creating event network-vif-plugged:eb277382-54d6-4a0a-8b01-2c0326eb53d2 for instance 661129a9-294b-4425-ac84-500d92de2cc6 on hv-cinder-85144 Aug 26 16:05:48.759525 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-721d97fe-efa9-424f-9950-910eaf642a44 req-8ac1f2d1-a6e6-4248-9b0f-b41feec5705e service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033751 Aug 26 16:05:48.760108 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 617/1244] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:05:48.862754 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-59684c5c-f9ea-45d4-9f51-172d27581779 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:48.863487 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-59684c5c-f9ea-45d4-9f51-172d27581779 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:48.871633 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-59684c5c-f9ea-45d4-9f51-172d27581779 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:48.872462 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-59684c5c-f9ea-45d4-9f51-172d27581779 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:48.873073 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-59684c5c-f9ea-45d4-9f51-172d27581779 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:48.873764 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-59684c5c-f9ea-45d4-9f51-172d27581779 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:48.874375 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-59684c5c-f9ea-45d4-9f51-172d27581779 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:48.874983 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-59684c5c-f9ea-45d4-9f51-172d27581779 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:49.020833 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-59684c5c-f9ea-45d4-9f51-172d27581779 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:49.030075 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-59684c5c-f9ea-45d4-9f51-172d27581779 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6" status: 200 len: 1265 microversion: 2.1 time: 0.171668 Aug 26 16:05:49.030635 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 628/1245] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:48 2022] GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:50.057195 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-003da86b-8dd7-45c3-b0d7-efedf9ff059b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:50.057814 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-003da86b-8dd7-45c3-b0d7-efedf9ff059b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:50.064010 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-003da86b-8dd7-45c3-b0d7-efedf9ff059b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:50.064795 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-003da86b-8dd7-45c3-b0d7-efedf9ff059b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:50.065233 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-003da86b-8dd7-45c3-b0d7-efedf9ff059b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:50.065923 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-003da86b-8dd7-45c3-b0d7-efedf9ff059b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:50.066376 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-003da86b-8dd7-45c3-b0d7-efedf9ff059b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:50.066804 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-003da86b-8dd7-45c3-b0d7-efedf9ff059b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:50.229695 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-003da86b-8dd7-45c3-b0d7-efedf9ff059b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:50.237730 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-003da86b-8dd7-45c3-b0d7-efedf9ff059b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6" status: 200 len: 1265 microversion: 2.1 time: 0.185361 Aug 26 16:05:50.238295 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 618/1246] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:50 2022] GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:51.258223 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-4792ae3e-5d51-48d5-9bfb-02e0f9649512 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:51.258776 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-4792ae3e-5d51-48d5-9bfb-02e0f9649512 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:51.265382 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4792ae3e-5d51-48d5-9bfb-02e0f9649512 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:51.265861 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4792ae3e-5d51-48d5-9bfb-02e0f9649512 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:51.266294 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4792ae3e-5d51-48d5-9bfb-02e0f9649512 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:51.267035 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4792ae3e-5d51-48d5-9bfb-02e0f9649512 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:51.267495 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4792ae3e-5d51-48d5-9bfb-02e0f9649512 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:51.267923 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4792ae3e-5d51-48d5-9bfb-02e0f9649512 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:51.271975 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=57 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:05:51.407326 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-4792ae3e-5d51-48d5-9bfb-02e0f9649512 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:51.422790 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-4792ae3e-5d51-48d5-9bfb-02e0f9649512 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6" status: 200 len: 1451 microversion: 2.1 time: 0.168569 Aug 26 16:05:51.423577 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 629/1247] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:51 2022] GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 => generated 1451 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:51.445992 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-b12742d9-8927-4dec-860b-c063295c9a85 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:05:51.447492 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-b12742d9-8927-4dec-860b-c063295c9a85 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:05:51.454244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b12742d9-8927-4dec-860b-c063295c9a85 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:51.454942 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b12742d9-8927-4dec-860b-c063295c9a85 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:51.455560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b12742d9-8927-4dec-860b-c063295c9a85 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:51.456565 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b12742d9-8927-4dec-860b-c063295c9a85 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:51.457035 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b12742d9-8927-4dec-860b-c063295c9a85 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:51.457463 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-b12742d9-8927-4dec-860b-c063295c9a85 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:51.604993 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-b12742d9-8927-4dec-860b-c063295c9a85 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:05:51.615517 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-b12742d9-8927-4dec-860b-c063295c9a85 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6" status: 200 len: 1451 microversion: 2.1 time: 0.171505 Aug 26 16:05:51.615517 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 619/1248] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:05:51 2022] GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 => generated 1451 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:05:54.124254 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-a4afa733-aac7-449c-847d-f90428a2769f req-fcfb6099-67e8-44b9-80b0-e640ca378dcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "661129a9-294b-4425-ac84-500d92de2cc6", "tag": "eb277382-54d6-4a0a-8b01-2c0326eb53d2"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:05:54.140208 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-a4afa733-aac7-449c-847d-f90428a2769f req-fcfb6099-67e8-44b9-80b0-e640ca378dcb service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:05:54.140686 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-a4afa733-aac7-449c-847d-f90428a2769f req-fcfb6099-67e8-44b9-80b0-e640ca378dcb service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:05:54.141116 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-a4afa733-aac7-449c-847d-f90428a2769f req-fcfb6099-67e8-44b9-80b0-e640ca378dcb service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:05:54.154152 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-a4afa733-aac7-449c-847d-f90428a2769f req-fcfb6099-67e8-44b9-80b0-e640ca378dcb service nova] Creating event network-changed:eb277382-54d6-4a0a-8b01-2c0326eb53d2 for instance 661129a9-294b-4425-ac84-500d92de2cc6 on hv-cinder-85144 Aug 26 16:05:54.159438 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-a4afa733-aac7-449c-847d-f90428a2769f req-fcfb6099-67e8-44b9-80b0-e640ca378dcb service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040564 Aug 26 16:05:54.160041 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 630/1249] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:06:39.846325 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-d03d1822-ffeb-43fe-86a3-c1c68573c212 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:39.846875 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_api:SELECT=23 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:06:39.848027 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=7 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:06:39.848284 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-d03d1822-ffeb-43fe-86a3-c1c68573c212 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:39.852780 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-3ea478f5-83f3-4014-8501-81a4465dfec7 req-5ce9eced-e41d-4865-a706-f2ffc13eef2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b456054b-9e50-43c0-ae5a-8f614cbc102b", "tag": "7450399c-70d1-4b9d-9b20-fdef692f4a6d"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:06:39.855595 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_api:SELECT=23 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:06:39.856433 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=56 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:06:39.859190 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d03d1822-ffeb-43fe-86a3-c1c68573c212 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:39.859810 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d03d1822-ffeb-43fe-86a3-c1c68573c212 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:39.860346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d03d1822-ffeb-43fe-86a3-c1c68573c212 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:39.861148 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d03d1822-ffeb-43fe-86a3-c1c68573c212 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:39.861830 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d03d1822-ffeb-43fe-86a3-c1c68573c212 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:39.862348 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d03d1822-ffeb-43fe-86a3-c1c68573c212 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:39.863889 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-3ea478f5-83f3-4014-8501-81a4465dfec7 req-5ce9eced-e41d-4865-a706-f2ffc13eef2f service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:39.864462 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-3ea478f5-83f3-4014-8501-81a4465dfec7 req-5ce9eced-e41d-4865-a706-f2ffc13eef2f service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:39.864933 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-3ea478f5-83f3-4014-8501-81a4465dfec7 req-5ce9eced-e41d-4865-a706-f2ffc13eef2f service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:39.877580 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-3ea478f5-83f3-4014-8501-81a4465dfec7 req-5ce9eced-e41d-4865-a706-f2ffc13eef2f service nova] Creating event network-changed:7450399c-70d1-4b9d-9b20-fdef692f4a6d for instance b456054b-9e50-43c0-ae5a-8f614cbc102b on hv-cinder-85144 Aug 26 16:06:39.883634 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-3ea478f5-83f3-4014-8501-81a4465dfec7 req-5ce9eced-e41d-4865-a706-f2ffc13eef2f service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038219 Aug 26 16:06:39.889571 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 631/1250] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:06:39.906702 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-d03d1822-ffeb-43fe-86a3-c1c68573c212 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Going to try to terminate instance {{(pid=128304) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 16:06:40.260600 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-d03d1822-ffeb-43fe-86a3-c1c68573c212 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "DELETE /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 204 len: 0 microversion: 2.1 time: 0.419386 Aug 26 16:06:40.261135 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 620/1251] 10.222.0.94 () {58 vars in 1239 bytes} [Fri Aug 26 16:06:39 2022] DELETE /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 16:06:40.271083 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-f6c24c05-1329-4d49-b69c-4f7ac1bf2a11 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:40.272224 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-f6c24c05-1329-4d49-b69c-4f7ac1bf2a11 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:40.280660 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f6c24c05-1329-4d49-b69c-4f7ac1bf2a11 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:40.281431 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f6c24c05-1329-4d49-b69c-4f7ac1bf2a11 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:40.282026 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f6c24c05-1329-4d49-b69c-4f7ac1bf2a11 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:40.283215 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f6c24c05-1329-4d49-b69c-4f7ac1bf2a11 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:40.283862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f6c24c05-1329-4d49-b69c-4f7ac1bf2a11 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:40.284446 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f6c24c05-1329-4d49-b69c-4f7ac1bf2a11 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:40.615690 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-f6c24c05-1329-4d49-b69c-4f7ac1bf2a11 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:40.630074 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-f6c24c05-1329-4d49-b69c-4f7ac1bf2a11 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1569 microversion: 2.1 time: 0.357956 Aug 26 16:06:40.630074 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 632/1252] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:40 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1569 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:41.646947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-8f2a6db6-0de1-4475-ac5c-c3c63a56b817 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:41.647719 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-8f2a6db6-0de1-4475-ac5c-c3c63a56b817 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:41.654087 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8f2a6db6-0de1-4475-ac5c-c3c63a56b817 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:41.654998 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8f2a6db6-0de1-4475-ac5c-c3c63a56b817 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:41.655129 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8f2a6db6-0de1-4475-ac5c-c3c63a56b817 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:41.655796 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8f2a6db6-0de1-4475-ac5c-c3c63a56b817 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:41.656267 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8f2a6db6-0de1-4475-ac5c-c3c63a56b817 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:41.657374 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8f2a6db6-0de1-4475-ac5c-c3c63a56b817 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:41.980807 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-8f2a6db6-0de1-4475-ac5c-c3c63a56b817 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:41.988623 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-8f2a6db6-0de1-4475-ac5c-c3c63a56b817 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1569 microversion: 2.1 time: 0.347505 Aug 26 16:06:41.989185 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 621/1253] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:41 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1569 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:42.903785 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-044b801a-f26e-408e-be7d-afaa861355f3 req-3be23ecc-64e8-44e6-a13c-e6a7dd6af6a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b456054b-9e50-43c0-ae5a-8f614cbc102b", "name": "network-vif-deleted", "tag": "7450399c-70d1-4b9d-9b20-fdef692f4a6d"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:06:42.914362 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-044b801a-f26e-408e-be7d-afaa861355f3 req-3be23ecc-64e8-44e6-a13c-e6a7dd6af6a3 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:42.914898 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-044b801a-f26e-408e-be7d-afaa861355f3 req-3be23ecc-64e8-44e6-a13c-e6a7dd6af6a3 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:42.915346 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-044b801a-f26e-408e-be7d-afaa861355f3 req-3be23ecc-64e8-44e6-a13c-e6a7dd6af6a3 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:42.928739 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-044b801a-f26e-408e-be7d-afaa861355f3 req-3be23ecc-64e8-44e6-a13c-e6a7dd6af6a3 service nova] Creating event network-vif-deleted:7450399c-70d1-4b9d-9b20-fdef692f4a6d for instance b456054b-9e50-43c0-ae5a-8f614cbc102b on hv-cinder-85144 Aug 26 16:06:42.934138 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-044b801a-f26e-408e-be7d-afaa861355f3 req-3be23ecc-64e8-44e6-a13c-e6a7dd6af6a3 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034045 Aug 26 16:06:42.934737 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 633/1254] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:06:43.010241 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-d74b1305-28df-4a75-b355-d350ab80efa4 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:43.011269 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-d74b1305-28df-4a75-b355-d350ab80efa4 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:43.017875 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d74b1305-28df-4a75-b355-d350ab80efa4 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:43.020172 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d74b1305-28df-4a75-b355-d350ab80efa4 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:43.020172 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d74b1305-28df-4a75-b355-d350ab80efa4 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:43.020172 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d74b1305-28df-4a75-b355-d350ab80efa4 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:43.020506 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d74b1305-28df-4a75-b355-d350ab80efa4 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:43.020921 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d74b1305-28df-4a75-b355-d350ab80efa4 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:43.128551 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-d74b1305-28df-4a75-b355-d350ab80efa4 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:43.148388 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-d74b1305-28df-4a75-b355-d350ab80efa4 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1383 microversion: 2.1 time: 0.141919 Aug 26 16:06:43.150345 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 622/1255] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:43 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1383 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:44.176814 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-8998b621-6d2e-4276-a6b1-0aa7ea70c211 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:44.178087 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-8998b621-6d2e-4276-a6b1-0aa7ea70c211 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:44.184135 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8998b621-6d2e-4276-a6b1-0aa7ea70c211 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:44.184603 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8998b621-6d2e-4276-a6b1-0aa7ea70c211 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:44.185033 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8998b621-6d2e-4276-a6b1-0aa7ea70c211 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:44.185758 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8998b621-6d2e-4276-a6b1-0aa7ea70c211 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:44.186217 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8998b621-6d2e-4276-a6b1-0aa7ea70c211 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:44.186643 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8998b621-6d2e-4276-a6b1-0aa7ea70c211 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:44.221496 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8998b621-6d2e-4276-a6b1-0aa7ea70c211 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:44.221986 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8998b621-6d2e-4276-a6b1-0aa7ea70c211 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:44.222406 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8998b621-6d2e-4276-a6b1-0aa7ea70c211 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:44.222852 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-8998b621-6d2e-4276-a6b1-0aa7ea70c211 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lazy-loading 'fault' on Instance uuid b456054b-9e50-43c0-ae5a-8f614cbc102b {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:06:44.267805 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-8998b621-6d2e-4276-a6b1-0aa7ea70c211 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3abcfcc7c6408994e27b7c9937c2be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea82b722416a415393ff78428a277a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:06:44.277859 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-8998b621-6d2e-4276-a6b1-0aa7ea70c211 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 200 len: 1225 microversion: 2.1 time: 0.105661 Aug 26 16:06:44.278726 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 634/1256] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:44 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:06:45.299654 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ebd120b5-9108-47f4-bfe2-d651e21e63a7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:45.300297 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ebd120b5-9108-47f4-bfe2-d651e21e63a7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] [instance: b456054b-9e50-43c0-ae5a-8f614cbc102b] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:06:45.307669 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebd120b5-9108-47f4-bfe2-d651e21e63a7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:45.308148 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebd120b5-9108-47f4-bfe2-d651e21e63a7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:45.308581 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebd120b5-9108-47f4-bfe2-d651e21e63a7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:45.309267 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebd120b5-9108-47f4-bfe2-d651e21e63a7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:06:45.309713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebd120b5-9108-47f4-bfe2-d651e21e63a7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:06:45.310130 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebd120b5-9108-47f4-bfe2-d651e21e63a7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:06:45.323822 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-ebd120b5-9108-47f4-bfe2-d651e21e63a7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] HTTP exception thrown: Instance b456054b-9e50-43c0-ae5a-8f614cbc102b could not be found. Aug 26 16:06:45.325440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ebd120b5-9108-47f4-bfe2-d651e21e63a7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Request method failure captured: Aug 26 16:06:45.325440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b HTTP/1.1 Aug 26 16:06:45.325440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 16:06:45.325440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 16:06:45.325440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 16:06:45.325440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 0 Aug 26 16:06:45.325440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 16:06:45.325440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 16:06:45.325440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 16:06:45.325440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 16:06:45.325440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO40f7Ai3L95Y_sqwdjXxzeotrik-8UaKRlJExedNiV1DA-3woGLOWKKfi_Krhx40OHuIYvbOL4vZdts39xsR4AMBu4a35fU4NJau9inVzuETrEIGHyKhd5jp0Oxh--970XWdGYUySnEfQRYy6LoYCcHTw22ESG34ZZup47rhhe2Gfo Aug 26 16:06:45.325440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 16:06:45.325440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 16:06:45.325440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 16:06:45.325440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 16:06:45.325440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 16:06:45.325440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 16:06:45.325440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: ea82b722416a415393ff78428a277a01 Aug 26 16:06:45.325440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-TestShelveInstance-1797275775 Aug 26 16:06:45.325440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 16:06:45.325440 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 16:06:45.327320 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/ea82b722416a415393ff78428a277a01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/ea82b722416a415393ff78428a277a01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/ea82b722416a415393ff78428a277a01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_ea82b722416a415393ff78428a277a01", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:06:45.327320 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-TestShelveInstance-1797275775 Aug 26 16:06:45.327320 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: ea82b722416a415393ff78428a277a01 Aug 26 16:06:45.327320 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-TestShelveInstance-1797275775 Aug 26 16:06:45.327320 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-TestShelveInstance-1797275775-project Aug 26 16:06:45.327320 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 16:06:45.327320 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 16:06:45.327320 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: 3b3abcfcc7c6408994e27b7c9937c2be Aug 26 16:06:45.327320 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-TestShelveInstance-1797275775-project Aug 26 16:06:45.327320 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: > Aug 26 16:06:45.327320 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Instance b456054b-9e50-43c0-ae5a-8f614cbc102b could not be found. Aug 26 16:06:45.327320 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'id': 'b456054b-9e50-43c0-ae5a-8f614cbc102b'} Aug 26 16:06:45.328518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:06:45.328518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:06:45.328518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:06:45.328518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:06:45.328518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:06:45.328518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:06:45.328518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:06:45.328518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:06:45.328518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:06:45.328518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:06:45.328518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b456054b-9e50-43c0-ae5a-8f614cbc102b could not be found. Aug 26 16:06:45.328518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:06:45.328518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:06:45.328518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:06:45.328518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:06:45.328518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:06:45.328518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:06:45.328518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:06:45.328518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:06:45.328518 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:06:45.330326 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:06:45.330326 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:06:45.330326 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:06:45.330326 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:06:45.330326 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:06:45.330326 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:06:45.330326 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:06:45.330326 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b456054b-9e50-43c0-ae5a-8f614cbc102b could not be found. Aug 26 16:06:45.330326 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:06:45.330326 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:06:45.330326 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:06:45.330326 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:06:45.330326 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:06:45.330326 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:06:45.330326 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:06:45.330326 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:06:45.330326 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b456054b-9e50-43c0-ae5a-8f614cbc102b could not be found. Aug 26 16:06:45.330326 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:06:45.332023 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ebd120b5-9108-47f4-bfe2-d651e21e63a7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Returning 404 to user: Instance b456054b-9e50-43c0-ae5a-8f614cbc102b could not be found. {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:06:45.332023 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ebd120b5-9108-47f4-bfe2-d651e21e63a7 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b" status: 404 len: 111 microversion: 2.1 time: 0.031221 Aug 26 16:06:45.332023 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 623/1257] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:06:45 2022] GET /compute/v2.1/servers/b456054b-9e50-43c0-ae5a-8f614cbc102b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:06:45.636750 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-dde2ddd4-0b74-4ea1-9e37-ab4fa9cb8379 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] Calling method '.version_select at 0x7f15d97a6700>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:06:45.769439 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-dde2ddd4-0b74-4ea1-9e37-ab4fa9cb8379 tempest-TestShelveInstance-1797275775 tempest-TestShelveInstance-1797275775-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1225209664" status: 202 len: 0 microversion: 2.1 time: 0.136700 Aug 26 16:06:45.770018 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 635/1258] 10.222.0.94 () {58 vars in 1254 bytes} [Fri Aug 26 16:06:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1225209664 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 16:07:52.049186 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 16:07:52.049779 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Fri Aug 26 16:07:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 (ip 10.222.0.94) !!! Aug 26 16:07:52.050390 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:07:52.051400 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:07:52.055472 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-55af2136-9f47-4e99-89e9-0a5d2d3ddf49 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:07:52.055978 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-55af2136-9f47-4e99-89e9-0a5d2d3ddf49 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:07:52.065883 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-55af2136-9f47-4e99-89e9-0a5d2d3ddf49 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:07:52.066375 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-55af2136-9f47-4e99-89e9-0a5d2d3ddf49 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:07:52.066817 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-55af2136-9f47-4e99-89e9-0a5d2d3ddf49 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:07:52.067544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-55af2136-9f47-4e99-89e9-0a5d2d3ddf49 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:07:52.068002 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-55af2136-9f47-4e99-89e9-0a5d2d3ddf49 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:07:52.074470 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-55af2136-9f47-4e99-89e9-0a5d2d3ddf49 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:07:52.094028 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-55af2136-9f47-4e99-89e9-0a5d2d3ddf49 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] Going to try to terminate instance {{(pid=128304) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 16:07:52.389538 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-55af2136-9f47-4e99-89e9-0a5d2d3ddf49 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "DELETE /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6" status: 204 len: 0 microversion: 2.1 time: 0.342345 Aug 26 16:07:52.390157 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 624/1259] 10.222.0.94 () {58 vars in 1239 bytes} [Fri Aug 26 16:07:52 2022] DELETE /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 16:07:52.397021 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=18 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:07:52.398557 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:07:52.402799 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-e411ec3e-6ad3-44dd-8315-a64075316b1b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:07:52.403450 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-e411ec3e-6ad3-44dd-8315-a64075316b1b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:07:52.410426 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e411ec3e-6ad3-44dd-8315-a64075316b1b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:07:52.410907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e411ec3e-6ad3-44dd-8315-a64075316b1b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:07:52.411364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e411ec3e-6ad3-44dd-8315-a64075316b1b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:07:52.412056 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e411ec3e-6ad3-44dd-8315-a64075316b1b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:07:52.412508 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e411ec3e-6ad3-44dd-8315-a64075316b1b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:07:52.412937 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e411ec3e-6ad3-44dd-8315-a64075316b1b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:07:52.545309 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-e411ec3e-6ad3-44dd-8315-a64075316b1b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:07:52.552953 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-e411ec3e-6ad3-44dd-8315-a64075316b1b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6" status: 200 len: 1576 microversion: 2.1 time: 0.158535 Aug 26 16:07:52.553509 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 636/1260] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:07:52 2022] GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:07:53.577560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-8afdc111-40b9-4a5b-970a-a5db103ee447 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:07:53.577991 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-8afdc111-40b9-4a5b-970a-a5db103ee447 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:07:53.584939 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8afdc111-40b9-4a5b-970a-a5db103ee447 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:07:53.585442 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8afdc111-40b9-4a5b-970a-a5db103ee447 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:07:53.585866 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8afdc111-40b9-4a5b-970a-a5db103ee447 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:07:53.586568 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8afdc111-40b9-4a5b-970a-a5db103ee447 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:07:53.587053 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8afdc111-40b9-4a5b-970a-a5db103ee447 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:07:53.587508 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8afdc111-40b9-4a5b-970a-a5db103ee447 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:07:53.721311 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-8afdc111-40b9-4a5b-970a-a5db103ee447 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:07:53.729264 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-8afdc111-40b9-4a5b-970a-a5db103ee447 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6" status: 200 len: 1576 microversion: 2.1 time: 0.158992 Aug 26 16:07:53.729835 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 625/1261] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:07:53 2022] GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:07:54.751158 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-40e1bd28-daa7-4f15-9a1e-135156b558ae tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:07:54.751934 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-40e1bd28-daa7-4f15-9a1e-135156b558ae tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:07:54.758195 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-40e1bd28-daa7-4f15-9a1e-135156b558ae tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:07:54.758667 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-40e1bd28-daa7-4f15-9a1e-135156b558ae tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:07:54.759132 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-40e1bd28-daa7-4f15-9a1e-135156b558ae tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:07:54.759848 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-40e1bd28-daa7-4f15-9a1e-135156b558ae tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:07:54.760294 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-40e1bd28-daa7-4f15-9a1e-135156b558ae tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:07:54.760712 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-40e1bd28-daa7-4f15-9a1e-135156b558ae tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:07:54.979757 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-40e1bd28-daa7-4f15-9a1e-135156b558ae tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:07:54.987457 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-40e1bd28-daa7-4f15-9a1e-135156b558ae tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6" status: 200 len: 1576 microversion: 2.1 time: 0.240597 Aug 26 16:07:54.988017 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 637/1262] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:07:54 2022] GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 => generated 1576 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:07:55.335074 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-372f5e9d-2ea4-4dd3-8442-d55af664e38c req-7bba4f42-8b6c-458b-8b6f-fb41fa1f27e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "661129a9-294b-4425-ac84-500d92de2cc6", "name": "network-vif-deleted", "tag": "eb277382-54d6-4a0a-8b01-2c0326eb53d2"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:07:55.346165 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-372f5e9d-2ea4-4dd3-8442-d55af664e38c req-7bba4f42-8b6c-458b-8b6f-fb41fa1f27e9 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:07:55.346638 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-372f5e9d-2ea4-4dd3-8442-d55af664e38c req-7bba4f42-8b6c-458b-8b6f-fb41fa1f27e9 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:07:55.347104 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-372f5e9d-2ea4-4dd3-8442-d55af664e38c req-7bba4f42-8b6c-458b-8b6f-fb41fa1f27e9 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:07:55.360925 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-372f5e9d-2ea4-4dd3-8442-d55af664e38c req-7bba4f42-8b6c-458b-8b6f-fb41fa1f27e9 service nova] Creating event network-vif-deleted:eb277382-54d6-4a0a-8b01-2c0326eb53d2 for instance 661129a9-294b-4425-ac84-500d92de2cc6 on hv-cinder-85144 Aug 26 16:07:55.366422 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-372f5e9d-2ea4-4dd3-8442-d55af664e38c req-7bba4f42-8b6c-458b-8b6f-fb41fa1f27e9 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174109 Aug 26 16:07:55.367500 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 626/1263] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:07:56.009049 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-ab74fcc6-5430-4109-92b7-96265092e309 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:07:56.010437 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-ab74fcc6-5430-4109-92b7-96265092e309 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:07:56.016529 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ab74fcc6-5430-4109-92b7-96265092e309 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:07:56.024257 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ab74fcc6-5430-4109-92b7-96265092e309 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:07:56.024257 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ab74fcc6-5430-4109-92b7-96265092e309 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:07:56.024257 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ab74fcc6-5430-4109-92b7-96265092e309 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:07:56.024257 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ab74fcc6-5430-4109-92b7-96265092e309 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:07:56.024685 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ab74fcc6-5430-4109-92b7-96265092e309 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:07:56.053525 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ab74fcc6-5430-4109-92b7-96265092e309 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:07:56.054051 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ab74fcc6-5430-4109-92b7-96265092e309 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:07:56.054437 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-ab74fcc6-5430-4109-92b7-96265092e309 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:07:56.054888 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-ab74fcc6-5430-4109-92b7-96265092e309 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lazy-loading 'fault' on Instance uuid 661129a9-294b-4425-ac84-500d92de2cc6 {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:07:56.104337 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-ab74fcc6-5430-4109-92b7-96265092e309 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:07:56.109903 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-ab74fcc6-5430-4109-92b7-96265092e309 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6" status: 200 len: 1230 microversion: 2.1 time: 0.104673 Aug 26 16:07:56.110523 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 638/1264] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:07:56 2022] GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:07:57.133022 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ca8286f2-5dac-4392-b8e5-639414996ea6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:07:57.133712 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ca8286f2-5dac-4392-b8e5-639414996ea6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:07:57.140573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ca8286f2-5dac-4392-b8e5-639414996ea6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:07:57.141088 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ca8286f2-5dac-4392-b8e5-639414996ea6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:07:57.141526 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ca8286f2-5dac-4392-b8e5-639414996ea6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:07:57.142218 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ca8286f2-5dac-4392-b8e5-639414996ea6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:07:57.142672 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ca8286f2-5dac-4392-b8e5-639414996ea6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:07:57.143145 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ca8286f2-5dac-4392-b8e5-639414996ea6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:07:57.156225 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-ca8286f2-5dac-4392-b8e5-639414996ea6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] HTTP exception thrown: Instance 661129a9-294b-4425-ac84-500d92de2cc6 could not be found. Aug 26 16:07:57.157827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ca8286f2-5dac-4392-b8e5-639414996ea6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Request method failure captured: Aug 26 16:07:57.157827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 HTTP/1.1 Aug 26 16:07:57.157827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 16:07:57.157827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 16:07:57.157827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 16:07:57.157827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 0 Aug 26 16:07:57.157827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 16:07:57.157827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 16:07:57.157827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 16:07:57.157827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 16:07:57.157827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO8kiDWM4vhVznoXwfR9MMqhXaAnXUM95N_VAGU8nUUvtlCXIPXxN2iNqstvUcM-VsO6rKcNS7Z80z_7oU4-jvse06U0FbaOF9gM4jljvLmV92GQj2QdWvoh7QTsLYK9UxEEA53VHKXRDgKFtbUwU9IvHnZxayI1b7d1-ia-ZnyaJw8 Aug 26 16:07:57.157827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 16:07:57.157827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 16:07:57.157827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 16:07:57.157827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 16:07:57.157827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 16:07:57.157827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 16:07:57.157827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: 3c5f0e0c02e64047b9ca17a7320b0bf5 Aug 26 16:07:57.157827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-TestVolumeBootPattern-1888948582 Aug 26 16:07:57.157827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 16:07:57.157827 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 16:07:57.159674 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3c5f0e0c02e64047b9ca17a7320b0bf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/3c5f0e0c02e64047b9ca17a7320b0bf5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3c5f0e0c02e64047b9ca17a7320b0bf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_3c5f0e0c02e64047b9ca17a7320b0bf5", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:07:57.159674 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-TestVolumeBootPattern-1888948582 Aug 26 16:07:57.159674 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: 3c5f0e0c02e64047b9ca17a7320b0bf5 Aug 26 16:07:57.159674 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-TestVolumeBootPattern-1888948582 Aug 26 16:07:57.159674 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-TestVolumeBootPattern-1888948582-project Aug 26 16:07:57.159674 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 16:07:57.159674 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 16:07:57.159674 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: c911a9324cb744a6a1aeb068565d3f89 Aug 26 16:07:57.159674 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-TestVolumeBootPattern-1888948582-project Aug 26 16:07:57.159674 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: > Aug 26 16:07:57.159674 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Instance 661129a9-294b-4425-ac84-500d92de2cc6 could not be found. Aug 26 16:07:57.159674 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'id': '661129a9-294b-4425-ac84-500d92de2cc6'} Aug 26 16:07:57.160947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:07:57.160947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:07:57.160947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:07:57.160947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:07:57.160947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:07:57.160947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:07:57.160947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:07:57.160947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:07:57.160947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:07:57.160947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:07:57.160947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 661129a9-294b-4425-ac84-500d92de2cc6 could not be found. Aug 26 16:07:57.160947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:07:57.160947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:07:57.160947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:07:57.160947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:07:57.160947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:07:57.160947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:07:57.160947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:07:57.160947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:07:57.160947 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:07:57.162718 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:07:57.162718 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:07:57.162718 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:07:57.162718 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:07:57.162718 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:07:57.162718 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:07:57.162718 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:07:57.162718 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 661129a9-294b-4425-ac84-500d92de2cc6 could not be found. Aug 26 16:07:57.162718 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:07:57.162718 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:07:57.162718 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:07:57.162718 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:07:57.162718 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:07:57.162718 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:07:57.162718 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:07:57.162718 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:07:57.162718 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 661129a9-294b-4425-ac84-500d92de2cc6 could not be found. Aug 26 16:07:57.162718 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:07:57.164234 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ca8286f2-5dac-4392-b8e5-639414996ea6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Returning 404 to user: Instance 661129a9-294b-4425-ac84-500d92de2cc6 could not be found. {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:07:57.164234 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ca8286f2-5dac-4392-b8e5-639414996ea6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6" status: 404 len: 111 microversion: 2.1 time: 0.030867 Aug 26 16:07:57.164234 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 627/1265] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:07:57 2022] GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 16:07:57.257855 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-e1d5ef33-c64a-4640-aa2f-fd8ed7984aa6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-167032294", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1864094508", "security_groups": [{"name": "tempest-secgroup-smoke-641091027"}], "block_device_mapping_v2": [{"uuid": "238a9114-1331-489d-8dba-62e49cd4e45b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b0da63e8-a587-4953-adca-efb59d8c08a4"}]}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:07:57.370715 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.network.neutron [None req-e1d5ef33-c64a-4640-aa2f-fd8ed7984aa6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] validate_networks() for [('b0da63e8-a587-4953-adca-efb59d8c08a4', None, None, None, None, None)] {{(pid=128305) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 16:07:57.797442 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-e1d5ef33-c64a-4640-aa2f-fd8ed7984aa6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Flavor limits 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 16:07:57.797889 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-e1d5ef33-c64a-4640-aa2f-fd8ed7984aa6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Image limits 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 16:07:57.798359 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-e1d5ef33-c64a-4640-aa2f-fd8ed7984aa6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Flavor pref 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 16:07:57.798767 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-e1d5ef33-c64a-4640-aa2f-fd8ed7984aa6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Image pref 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 16:07:57.799201 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-e1d5ef33-c64a-4640-aa2f-fd8ed7984aa6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 16:07:57.809622 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e1d5ef33-c64a-4640-aa2f-fd8ed7984aa6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:07:57.810371 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e1d5ef33-c64a-4640-aa2f-fd8ed7984aa6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:07:57.811279 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e1d5ef33-c64a-4640-aa2f-fd8ed7984aa6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:07:57.812213 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e1d5ef33-c64a-4640-aa2f-fd8ed7984aa6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:07:57.812696 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e1d5ef33-c64a-4640-aa2f-fd8ed7984aa6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:07:57.813201 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e1d5ef33-c64a-4640-aa2f-fd8ed7984aa6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:07:57.832628 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-e1d5ef33-c64a-4640-aa2f-fd8ed7984aa6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Getting quotas for project 3c5f0e0c02e64047b9ca17a7320b0bf5. Resources: {'instances', 'ram', 'cores'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 16:07:57.836708 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-e1d5ef33-c64a-4640-aa2f-fd8ed7984aa6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Getting quotas for user c911a9324cb744a6a1aeb068565d3f89 and project 3c5f0e0c02e64047b9ca17a7320b0bf5. Resources: {'instances', 'ram', 'cores'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 16:07:57.894377 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-e1d5ef33-c64a-4640-aa2f-fd8ed7984aa6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Going to run 1 instances... {{(pid=128305) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 16:07:57.896589 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-e1d5ef33-c64a-4640-aa2f-fd8ed7984aa6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 53e773e1-f20a-476e-80a4-d6b769ee4004] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='238a9114-1331-489d-8dba-62e49cd4e45b',volume_size=None,volume_type=None)] {{(pid=128305) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 16:07:58.336198 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e1d5ef33-c64a-4640-aa2f-fd8ed7984aa6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [e543cfb0-f178-4060-80a4-fee28e245719] AMQP server on 10.222.0.94:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 26 16:07:59.344660 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO oslo.messaging._drivers.impl_rabbit [None req-e1d5ef33-c64a-4640-aa2f-fd8ed7984aa6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [e543cfb0-f178-4060-80a4-fee28e245719] Reconnected to AMQP server on 10.222.0.94:5672 via [amqp] client with port 38922. Aug 26 16:07:59.348979 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-e1d5ef33-c64a-4640-aa2f-fd8ed7984aa6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.094845 Aug 26 16:07:59.349630 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 639/1266] 10.222.0.94 () {60 vars in 1147 bytes} [Fri Aug 26 16:07:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 2097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 16:07:59.360437 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-fa7f4741-af92-4f63-a706-e142aaa5b9f0 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:07:59.361042 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-fa7f4741-af92-4f63-a706-e142aaa5b9f0 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 53e773e1-f20a-476e-80a4-d6b769ee4004] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:07:59.415356 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-fa7f4741-af92-4f63-a706-e142aaa5b9f0 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:07:59.423091 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-fa7f4741-af92-4f63-a706-e142aaa5b9f0 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004" status: 200 len: 1094 microversion: 2.1 time: 0.066395 Aug 26 16:07:59.423657 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 628/1267] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:07:59 2022] GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:08:00.445161 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-cc9de09e-2542-4578-9bb3-5d8f07524504 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:08:00.445780 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-cc9de09e-2542-4578-9bb3-5d8f07524504 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 53e773e1-f20a-476e-80a4-d6b769ee4004] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:08:00.452425 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cc9de09e-2542-4578-9bb3-5d8f07524504 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:00.452901 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cc9de09e-2542-4578-9bb3-5d8f07524504 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:00.453393 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cc9de09e-2542-4578-9bb3-5d8f07524504 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:00.454344 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cc9de09e-2542-4578-9bb3-5d8f07524504 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:00.454805 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cc9de09e-2542-4578-9bb3-5d8f07524504 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:00.455342 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cc9de09e-2542-4578-9bb3-5d8f07524504 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:00.520781 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-cc9de09e-2542-4578-9bb3-5d8f07524504 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:08:00.529236 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-cc9de09e-2542-4578-9bb3-5d8f07524504 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004" status: 200 len: 1144 microversion: 2.1 time: 0.089070 Aug 26 16:08:00.529805 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 640/1268] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:08:00 2022] GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004 => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:08:01.549776 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-6b5999b6-fe2b-4d07-9a86-86edf0d64059 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:08:01.550503 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-6b5999b6-fe2b-4d07-9a86-86edf0d64059 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 53e773e1-f20a-476e-80a4-d6b769ee4004] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:08:01.558644 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6b5999b6-fe2b-4d07-9a86-86edf0d64059 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:01.559193 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6b5999b6-fe2b-4d07-9a86-86edf0d64059 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:01.559640 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6b5999b6-fe2b-4d07-9a86-86edf0d64059 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:01.560356 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6b5999b6-fe2b-4d07-9a86-86edf0d64059 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:01.561074 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6b5999b6-fe2b-4d07-9a86-86edf0d64059 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:01.561507 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-6b5999b6-fe2b-4d07-9a86-86edf0d64059 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:01.635501 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-6b5999b6-fe2b-4d07-9a86-86edf0d64059 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:08:01.643402 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-6b5999b6-fe2b-4d07-9a86-86edf0d64059 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004" status: 200 len: 1200 microversion: 2.1 time: 0.097448 Aug 26 16:08:01.644160 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 629/1269] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:08:01 2022] GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004 => generated 1200 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:08:02.667434 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-b88fc692-fa20-424f-a7b5-de8358e92395 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:08:02.668304 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-b88fc692-fa20-424f-a7b5-de8358e92395 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 53e773e1-f20a-476e-80a4-d6b769ee4004] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:08:02.675570 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b88fc692-fa20-424f-a7b5-de8358e92395 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:02.676163 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b88fc692-fa20-424f-a7b5-de8358e92395 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:02.676848 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b88fc692-fa20-424f-a7b5-de8358e92395 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:02.677975 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b88fc692-fa20-424f-a7b5-de8358e92395 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:02.678534 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b88fc692-fa20-424f-a7b5-de8358e92395 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:02.679070 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b88fc692-fa20-424f-a7b5-de8358e92395 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:02.910450 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b88fc692-fa20-424f-a7b5-de8358e92395 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:08:02.920251 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-b88fc692-fa20-424f-a7b5-de8358e92395 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004" status: 200 len: 1277 microversion: 2.1 time: 0.257164 Aug 26 16:08:02.920765 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 641/1270] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:08:02 2022] GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004 => generated 1277 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:08:03.429014 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-4a6e6f9a-de01-4fa0-a55e-b9b72800b73a req-c2c36de3-3128-4ed2-9ec6-ea60856eba95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53e773e1-f20a-476e-80a4-d6b769ee4004", "tag": "9bcbb986-ec78-4b94-886b-b800f34b40eb"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:08:03.439096 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-4a6e6f9a-de01-4fa0-a55e-b9b72800b73a req-c2c36de3-3128-4ed2-9ec6-ea60856eba95 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:03.439615 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-4a6e6f9a-de01-4fa0-a55e-b9b72800b73a req-c2c36de3-3128-4ed2-9ec6-ea60856eba95 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:03.440042 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-4a6e6f9a-de01-4fa0-a55e-b9b72800b73a req-c2c36de3-3128-4ed2-9ec6-ea60856eba95 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:03.457593 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-4a6e6f9a-de01-4fa0-a55e-b9b72800b73a req-c2c36de3-3128-4ed2-9ec6-ea60856eba95 service nova] Creating event network-changed:9bcbb986-ec78-4b94-886b-b800f34b40eb for instance 53e773e1-f20a-476e-80a4-d6b769ee4004 on hv-cinder-85144 Aug 26 16:08:03.458307 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-4a6e6f9a-de01-4fa0-a55e-b9b72800b73a req-c2c36de3-3128-4ed2-9ec6-ea60856eba95 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033066 Aug 26 16:08:03.459335 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 630/1271] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:08:03.941938 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-1ff80d46-173a-42d0-8fad-95075d493545 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:08:03.942943 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-1ff80d46-173a-42d0-8fad-95075d493545 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 53e773e1-f20a-476e-80a4-d6b769ee4004] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:08:03.949654 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1ff80d46-173a-42d0-8fad-95075d493545 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:03.950124 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1ff80d46-173a-42d0-8fad-95075d493545 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:03.950548 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1ff80d46-173a-42d0-8fad-95075d493545 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:03.951274 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1ff80d46-173a-42d0-8fad-95075d493545 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:03.951717 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1ff80d46-173a-42d0-8fad-95075d493545 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:03.952134 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-1ff80d46-173a-42d0-8fad-95075d493545 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:04.166841 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-1ff80d46-173a-42d0-8fad-95075d493545 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:08:04.174805 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-1ff80d46-173a-42d0-8fad-95075d493545 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004" status: 200 len: 1265 microversion: 2.1 time: 0.236528 Aug 26 16:08:04.175220 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 642/1272] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:08:03 2022] GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004 => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:08:05.196849 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-d1b461b8-74f3-4af3-8175-a5aa92fc7849 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:08:05.197598 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-d1b461b8-74f3-4af3-8175-a5aa92fc7849 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 53e773e1-f20a-476e-80a4-d6b769ee4004] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:08:05.204312 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d1b461b8-74f3-4af3-8175-a5aa92fc7849 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:05.204797 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d1b461b8-74f3-4af3-8175-a5aa92fc7849 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:05.205238 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d1b461b8-74f3-4af3-8175-a5aa92fc7849 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:05.205940 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d1b461b8-74f3-4af3-8175-a5aa92fc7849 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:05.206398 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d1b461b8-74f3-4af3-8175-a5aa92fc7849 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:05.206828 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d1b461b8-74f3-4af3-8175-a5aa92fc7849 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:05.346551 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-d1b461b8-74f3-4af3-8175-a5aa92fc7849 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:08:05.355085 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-d1b461b8-74f3-4af3-8175-a5aa92fc7849 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004" status: 200 len: 1265 microversion: 2.1 time: 0.162549 Aug 26 16:08:05.355668 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 631/1273] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:08:05 2022] GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:08:06.375675 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-56d9d537-908b-474a-a717-5ead3056ea4e tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:08:06.376278 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-56d9d537-908b-474a-a717-5ead3056ea4e tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 53e773e1-f20a-476e-80a4-d6b769ee4004] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:08:06.382728 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-56d9d537-908b-474a-a717-5ead3056ea4e tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:06.383244 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-56d9d537-908b-474a-a717-5ead3056ea4e tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:06.383678 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-56d9d537-908b-474a-a717-5ead3056ea4e tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:06.385010 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-56d9d537-908b-474a-a717-5ead3056ea4e tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:06.385497 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-56d9d537-908b-474a-a717-5ead3056ea4e tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:06.385917 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-56d9d537-908b-474a-a717-5ead3056ea4e tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:06.519464 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-56d9d537-908b-474a-a717-5ead3056ea4e tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:08:06.527411 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-56d9d537-908b-474a-a717-5ead3056ea4e tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004" status: 200 len: 1265 microversion: 2.1 time: 0.155632 Aug 26 16:08:06.527975 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 643/1274] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:08:06 2022] GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:08:07.547741 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7622a918-c3e0-478f-9388-6c1503adda15 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:08:07.548358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-7622a918-c3e0-478f-9388-6c1503adda15 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 53e773e1-f20a-476e-80a4-d6b769ee4004] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:08:07.554662 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7622a918-c3e0-478f-9388-6c1503adda15 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:07.555185 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7622a918-c3e0-478f-9388-6c1503adda15 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:07.555705 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7622a918-c3e0-478f-9388-6c1503adda15 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:07.556521 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7622a918-c3e0-478f-9388-6c1503adda15 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:07.557005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7622a918-c3e0-478f-9388-6c1503adda15 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:07.557432 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7622a918-c3e0-478f-9388-6c1503adda15 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:07.698302 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7622a918-c3e0-478f-9388-6c1503adda15 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:08:07.706016 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-7622a918-c3e0-478f-9388-6c1503adda15 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004" status: 200 len: 1265 microversion: 2.1 time: 0.162302 Aug 26 16:08:07.706701 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 632/1275] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:08:07 2022] GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:08:08.727490 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-a76710a6-d6d1-4657-b4d8-10bab38c8f07 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:08:08.728207 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-a76710a6-d6d1-4657-b4d8-10bab38c8f07 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 53e773e1-f20a-476e-80a4-d6b769ee4004] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:08:08.730545 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell0:SELECT=2 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:08:08.731234 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell0:SELECT=6 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:08:08.736042 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a76710a6-d6d1-4657-b4d8-10bab38c8f07 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:08.736482 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a76710a6-d6d1-4657-b4d8-10bab38c8f07 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:08.736960 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a76710a6-d6d1-4657-b4d8-10bab38c8f07 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:08.737656 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a76710a6-d6d1-4657-b4d8-10bab38c8f07 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:08.738113 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a76710a6-d6d1-4657-b4d8-10bab38c8f07 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:08.738537 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-a76710a6-d6d1-4657-b4d8-10bab38c8f07 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:08.874097 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-a76710a6-d6d1-4657-b4d8-10bab38c8f07 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:08:08.882027 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-a76710a6-d6d1-4657-b4d8-10bab38c8f07 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004" status: 200 len: 1265 microversion: 2.1 time: 0.158808 Aug 26 16:08:08.882595 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 644/1276] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:08:08 2022] GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:08:09.903679 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-8e86d5c6-948e-4cd8-a147-c6514640af80 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:08:09.904302 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-8e86d5c6-948e-4cd8-a147-c6514640af80 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 53e773e1-f20a-476e-80a4-d6b769ee4004] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:08:09.906736 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell0:SELECT=2 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:08:09.911575 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8e86d5c6-948e-4cd8-a147-c6514640af80 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:09.912060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8e86d5c6-948e-4cd8-a147-c6514640af80 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:09.912544 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8e86d5c6-948e-4cd8-a147-c6514640af80 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:09.913245 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8e86d5c6-948e-4cd8-a147-c6514640af80 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:09.913704 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8e86d5c6-948e-4cd8-a147-c6514640af80 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:09.914131 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-8e86d5c6-948e-4cd8-a147-c6514640af80 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:10.044880 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-8e86d5c6-948e-4cd8-a147-c6514640af80 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:08:10.052630 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-8e86d5c6-948e-4cd8-a147-c6514640af80 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004" status: 200 len: 1265 microversion: 2.1 time: 0.153426 Aug 26 16:08:10.053208 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 633/1277] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:08:09 2022] GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:08:11.074046 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-31a087c4-ecf2-4985-8666-5b96957f6f88 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:08:11.074679 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-31a087c4-ecf2-4985-8666-5b96957f6f88 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 53e773e1-f20a-476e-80a4-d6b769ee4004] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:08:11.081066 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31a087c4-ecf2-4985-8666-5b96957f6f88 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:11.081546 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31a087c4-ecf2-4985-8666-5b96957f6f88 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:11.081980 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31a087c4-ecf2-4985-8666-5b96957f6f88 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:11.082671 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31a087c4-ecf2-4985-8666-5b96957f6f88 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:11.083266 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31a087c4-ecf2-4985-8666-5b96957f6f88 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:11.083692 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-31a087c4-ecf2-4985-8666-5b96957f6f88 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:11.215754 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-31a087c4-ecf2-4985-8666-5b96957f6f88 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:08:11.223404 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-31a087c4-ecf2-4985-8666-5b96957f6f88 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004" status: 200 len: 1265 microversion: 2.1 time: 0.153915 Aug 26 16:08:11.224369 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 645/1278] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:08:11 2022] GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:08:12.244488 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-af9c10d1-79f4-4158-a538-b2bf116c9fa8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:08:12.245069 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-af9c10d1-79f4-4158-a538-b2bf116c9fa8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 53e773e1-f20a-476e-80a4-d6b769ee4004] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:08:12.251283 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-af9c10d1-79f4-4158-a538-b2bf116c9fa8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:12.259296 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-af9c10d1-79f4-4158-a538-b2bf116c9fa8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:12.259296 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-af9c10d1-79f4-4158-a538-b2bf116c9fa8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:12.259296 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-af9c10d1-79f4-4158-a538-b2bf116c9fa8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:12.259296 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-af9c10d1-79f4-4158-a538-b2bf116c9fa8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:12.259816 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-af9c10d1-79f4-4158-a538-b2bf116c9fa8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:12.385090 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-af9c10d1-79f4-4158-a538-b2bf116c9fa8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:08:12.393282 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-af9c10d1-79f4-4158-a538-b2bf116c9fa8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004" status: 200 len: 1265 microversion: 2.1 time: 0.152749 Aug 26 16:08:12.393856 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 634/1279] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:08:12 2022] GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:08:13.414950 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-79712015-38ae-47cc-85ea-9de5b2a24fed tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:08:13.415641 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-79712015-38ae-47cc-85ea-9de5b2a24fed tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 53e773e1-f20a-476e-80a4-d6b769ee4004] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:08:13.423034 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-79712015-38ae-47cc-85ea-9de5b2a24fed tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:13.423524 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-79712015-38ae-47cc-85ea-9de5b2a24fed tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:13.424347 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-79712015-38ae-47cc-85ea-9de5b2a24fed tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:13.424646 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-79712015-38ae-47cc-85ea-9de5b2a24fed tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:13.425100 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-79712015-38ae-47cc-85ea-9de5b2a24fed tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:13.425527 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-79712015-38ae-47cc-85ea-9de5b2a24fed tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:13.558297 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-79712015-38ae-47cc-85ea-9de5b2a24fed tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:08:13.566686 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-79712015-38ae-47cc-85ea-9de5b2a24fed tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004" status: 200 len: 1265 microversion: 2.1 time: 0.156696 Aug 26 16:08:13.568716 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 646/1280] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:08:13 2022] GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:08:14.588948 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-59a3155c-5cf0-4d10-8412-72de3d6a9cb5 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:08:14.589566 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-59a3155c-5cf0-4d10-8412-72de3d6a9cb5 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 53e773e1-f20a-476e-80a4-d6b769ee4004] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:08:14.595988 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-59a3155c-5cf0-4d10-8412-72de3d6a9cb5 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:14.596471 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-59a3155c-5cf0-4d10-8412-72de3d6a9cb5 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:14.596908 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-59a3155c-5cf0-4d10-8412-72de3d6a9cb5 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:14.597599 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-59a3155c-5cf0-4d10-8412-72de3d6a9cb5 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:14.598054 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-59a3155c-5cf0-4d10-8412-72de3d6a9cb5 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:14.598481 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-59a3155c-5cf0-4d10-8412-72de3d6a9cb5 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:14.733701 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-59a3155c-5cf0-4d10-8412-72de3d6a9cb5 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:08:14.741422 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-59a3155c-5cf0-4d10-8412-72de3d6a9cb5 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004" status: 200 len: 1265 microversion: 2.1 time: 0.157118 Aug 26 16:08:14.741987 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 635/1281] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:08:14 2022] GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:08:15.422149 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-9c595a41-e818-4f7a-a087-502b781b1746 req-f0b341f1-95bd-4d58-9c1e-9404f9b90d55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53e773e1-f20a-476e-80a4-d6b769ee4004", "name": "network-vif-plugged", "status": "completed", "tag": "9bcbb986-ec78-4b94-886b-b800f34b40eb"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:08:15.432132 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-9c595a41-e818-4f7a-a087-502b781b1746 req-f0b341f1-95bd-4d58-9c1e-9404f9b90d55 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:15.432887 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-9c595a41-e818-4f7a-a087-502b781b1746 req-f0b341f1-95bd-4d58-9c1e-9404f9b90d55 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:15.433482 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-9c595a41-e818-4f7a-a087-502b781b1746 req-f0b341f1-95bd-4d58-9c1e-9404f9b90d55 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:15.445344 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-9c595a41-e818-4f7a-a087-502b781b1746 req-f0b341f1-95bd-4d58-9c1e-9404f9b90d55 service nova] Creating event network-vif-plugged:9bcbb986-ec78-4b94-886b-b800f34b40eb for instance 53e773e1-f20a-476e-80a4-d6b769ee4004 on hv-cinder-85144 Aug 26 16:08:15.451875 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-9c595a41-e818-4f7a-a087-502b781b1746 req-f0b341f1-95bd-4d58-9c1e-9404f9b90d55 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094050 Aug 26 16:08:15.452912 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 647/1282] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:08:15.761581 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-953b2360-6b71-4e6b-9ebd-d42cacfd9690 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:08:15.762226 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-953b2360-6b71-4e6b-9ebd-d42cacfd9690 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 53e773e1-f20a-476e-80a4-d6b769ee4004] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:08:15.769179 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-953b2360-6b71-4e6b-9ebd-d42cacfd9690 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:15.769663 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-953b2360-6b71-4e6b-9ebd-d42cacfd9690 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:15.770091 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-953b2360-6b71-4e6b-9ebd-d42cacfd9690 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:15.770816 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-953b2360-6b71-4e6b-9ebd-d42cacfd9690 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:15.771389 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-953b2360-6b71-4e6b-9ebd-d42cacfd9690 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:15.771833 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-953b2360-6b71-4e6b-9ebd-d42cacfd9690 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:15.975039 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-953b2360-6b71-4e6b-9ebd-d42cacfd9690 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:08:15.983299 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-953b2360-6b71-4e6b-9ebd-d42cacfd9690 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004" status: 200 len: 1265 microversion: 2.1 time: 0.225881 Aug 26 16:08:15.983869 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 636/1283] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:08:15 2022] GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:08:17.004503 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-02930137-072d-44c5-a3cd-30c0cbf752a8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:08:17.005202 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-02930137-072d-44c5-a3cd-30c0cbf752a8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 53e773e1-f20a-476e-80a4-d6b769ee4004] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:08:17.012419 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-02930137-072d-44c5-a3cd-30c0cbf752a8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:17.012901 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-02930137-072d-44c5-a3cd-30c0cbf752a8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:17.013364 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-02930137-072d-44c5-a3cd-30c0cbf752a8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:17.014059 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-02930137-072d-44c5-a3cd-30c0cbf752a8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:17.014509 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-02930137-072d-44c5-a3cd-30c0cbf752a8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:17.014959 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-02930137-072d-44c5-a3cd-30c0cbf752a8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:17.145373 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-02930137-072d-44c5-a3cd-30c0cbf752a8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:08:17.153537 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-02930137-072d-44c5-a3cd-30c0cbf752a8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004" status: 200 len: 1265 microversion: 2.1 time: 0.153361 Aug 26 16:08:17.154102 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 648/1284] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:08:16 2022] GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:08:18.174393 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-d5702c2e-6d05-42a9-b656-18fb167ae5eb tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:08:18.175048 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-d5702c2e-6d05-42a9-b656-18fb167ae5eb tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 53e773e1-f20a-476e-80a4-d6b769ee4004] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:08:18.182003 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d5702c2e-6d05-42a9-b656-18fb167ae5eb tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:18.182479 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d5702c2e-6d05-42a9-b656-18fb167ae5eb tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:18.182958 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d5702c2e-6d05-42a9-b656-18fb167ae5eb tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:18.183648 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d5702c2e-6d05-42a9-b656-18fb167ae5eb tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:18.184098 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d5702c2e-6d05-42a9-b656-18fb167ae5eb tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:18.184519 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-d5702c2e-6d05-42a9-b656-18fb167ae5eb tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:18.316932 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-d5702c2e-6d05-42a9-b656-18fb167ae5eb tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:08:18.324718 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-d5702c2e-6d05-42a9-b656-18fb167ae5eb tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004" status: 200 len: 1451 microversion: 2.1 time: 0.154337 Aug 26 16:08:18.325281 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 637/1285] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:08:18 2022] GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:08:18.345408 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-75b931c4-1696-46e9-9b97-29796d9cd948 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:08:18.346025 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-75b931c4-1696-46e9-9b97-29796d9cd948 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 53e773e1-f20a-476e-80a4-d6b769ee4004] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:08:18.353166 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-75b931c4-1696-46e9-9b97-29796d9cd948 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:18.353833 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-75b931c4-1696-46e9-9b97-29796d9cd948 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:18.354274 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-75b931c4-1696-46e9-9b97-29796d9cd948 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:18.354988 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-75b931c4-1696-46e9-9b97-29796d9cd948 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:18.355450 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-75b931c4-1696-46e9-9b97-29796d9cd948 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:18.355875 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-75b931c4-1696-46e9-9b97-29796d9cd948 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:18.488605 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-75b931c4-1696-46e9-9b97-29796d9cd948 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:08:18.496417 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-75b931c4-1696-46e9-9b97-29796d9cd948 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004" status: 200 len: 1451 microversion: 2.1 time: 0.155293 Aug 26 16:08:18.496983 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 649/1286] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:08:18 2022] GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:08:20.659757 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-32f3b724-37ee-4440-a86c-cf955f046684 req-0bdc146c-9bd8-4df3-8009-73bd80f31cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53e773e1-f20a-476e-80a4-d6b769ee4004", "tag": "9bcbb986-ec78-4b94-886b-b800f34b40eb"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:08:20.670707 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-32f3b724-37ee-4440-a86c-cf955f046684 req-0bdc146c-9bd8-4df3-8009-73bd80f31cb5 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:08:20.671356 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-32f3b724-37ee-4440-a86c-cf955f046684 req-0bdc146c-9bd8-4df3-8009-73bd80f31cb5 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:08:20.671869 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-32f3b724-37ee-4440-a86c-cf955f046684 req-0bdc146c-9bd8-4df3-8009-73bd80f31cb5 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:08:20.688456 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-32f3b724-37ee-4440-a86c-cf955f046684 req-0bdc146c-9bd8-4df3-8009-73bd80f31cb5 service nova] Creating event network-changed:9bcbb986-ec78-4b94-886b-b800f34b40eb for instance 53e773e1-f20a-476e-80a4-d6b769ee4004 on hv-cinder-85144 Aug 26 16:08:20.694483 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-32f3b724-37ee-4440-a86c-cf955f046684 req-0bdc146c-9bd8-4df3-8009-73bd80f31cb5 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038146 Aug 26 16:08:20.696016 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 638/1287] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:10:00.324341 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:10:00.325441 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=78 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:10:00.326591 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 16:10:00.326748 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Fri Aug 26 16:10:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.94) !!! Aug 26 16:10:00.332414 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-e9a491fc-71ae-4305-bb90-78db46fc2648 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-877273053", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1864094508", "security_groups": [{"name": "tempest-secgroup-smoke-641091027"}], "block_device_mapping_v2": [{"uuid": "9633d2ab-62ff-4575-a7ad-5fddf8820280", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b0da63e8-a587-4953-adca-efb59d8c08a4"}]}} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:10:00.448420 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.network.neutron [None req-e9a491fc-71ae-4305-bb90-78db46fc2648 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] validate_networks() for [('b0da63e8-a587-4953-adca-efb59d8c08a4', None, None, None, None, None)] {{(pid=128305) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 16:10:00.815101 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-e9a491fc-71ae-4305-bb90-78db46fc2648 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Flavor limits 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 16:10:00.815562 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-e9a491fc-71ae-4305-bb90-78db46fc2648 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Image limits 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 16:10:00.816061 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-e9a491fc-71ae-4305-bb90-78db46fc2648 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Flavor pref 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 16:10:00.816593 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-e9a491fc-71ae-4305-bb90-78db46fc2648 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Image pref 0:0:0 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 16:10:00.817010 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.virt.hardware [None req-e9a491fc-71ae-4305-bb90-78db46fc2648 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 16:10:00.826440 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e9a491fc-71ae-4305-bb90-78db46fc2648 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:00.826945 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e9a491fc-71ae-4305-bb90-78db46fc2648 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:00.827403 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e9a491fc-71ae-4305-bb90-78db46fc2648 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:00.828131 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e9a491fc-71ae-4305-bb90-78db46fc2648 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:00.828584 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e9a491fc-71ae-4305-bb90-78db46fc2648 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:00.829010 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-e9a491fc-71ae-4305-bb90-78db46fc2648 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:00.846212 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-e9a491fc-71ae-4305-bb90-78db46fc2648 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Getting quotas for project 3c5f0e0c02e64047b9ca17a7320b0bf5. Resources: {'instances', 'ram', 'cores'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 16:10:00.850485 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.quota [None req-e9a491fc-71ae-4305-bb90-78db46fc2648 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Getting quotas for user c911a9324cb744a6a1aeb068565d3f89 and project 3c5f0e0c02e64047b9ca17a7320b0bf5. Resources: {'instances', 'ram', 'cores'} {{(pid=128305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 16:10:00.907650 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-e9a491fc-71ae-4305-bb90-78db46fc2648 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Going to run 1 instances... {{(pid=128305) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 16:10:00.909759 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-e9a491fc-71ae-4305-bb90-78db46fc2648 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 4fff8127-cbc0-47db-abf4-4e5bb5c211e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9633d2ab-62ff-4575-a7ad-5fddf8820280',volume_size=None,volume_type=None)] {{(pid=128305) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 16:10:01.329778 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-e9a491fc-71ae-4305-bb90-78db46fc2648 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.007177 Aug 26 16:10:01.330702 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 650/1288] 10.222.0.94 () {60 vars in 1147 bytes} [Fri Aug 26 16:10:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 16:10:01.340050 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 16:10:01.343193 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Fri Aug 26 16:10:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8 (ip 10.222.0.94) !!! Aug 26 16:10:01.343193 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:10:01.343193 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:10:01.346607 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-e51ca15f-393f-48b5-ab27-daede22a76c6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:10:01.348365 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-e51ca15f-393f-48b5-ab27-daede22a76c6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 4fff8127-cbc0-47db-abf4-4e5bb5c211e8] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:10:01.416746 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-e51ca15f-393f-48b5-ab27-daede22a76c6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:10:01.424143 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-e51ca15f-393f-48b5-ab27-daede22a76c6 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8" status: 200 len: 1094 microversion: 2.1 time: 0.086191 Aug 26 16:10:01.424719 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 639/1289] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:10:01 2022] GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8 => generated 1094 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:10:02.447190 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-f79275c2-9dee-4655-a3e3-45c2e505db68 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:10:02.447822 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-f79275c2-9dee-4655-a3e3-45c2e505db68 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 4fff8127-cbc0-47db-abf4-4e5bb5c211e8] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:10:02.454013 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f79275c2-9dee-4655-a3e3-45c2e505db68 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:02.459413 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f79275c2-9dee-4655-a3e3-45c2e505db68 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:02.459413 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f79275c2-9dee-4655-a3e3-45c2e505db68 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:02.459413 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f79275c2-9dee-4655-a3e3-45c2e505db68 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:02.459413 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f79275c2-9dee-4655-a3e3-45c2e505db68 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:02.459848 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f79275c2-9dee-4655-a3e3-45c2e505db68 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:02.521504 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-f79275c2-9dee-4655-a3e3-45c2e505db68 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:10:02.529325 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-f79275c2-9dee-4655-a3e3-45c2e505db68 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8" status: 200 len: 1144 microversion: 2.1 time: 0.087501 Aug 26 16:10:02.529906 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 651/1290] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:10:02 2022] GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:10:03.550070 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-027b2d57-c872-4d03-a794-fddf0cca8b19 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:10:03.550684 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-027b2d57-c872-4d03-a794-fddf0cca8b19 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 4fff8127-cbc0-47db-abf4-4e5bb5c211e8] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:10:03.559276 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-027b2d57-c872-4d03-a794-fddf0cca8b19 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:03.559710 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-027b2d57-c872-4d03-a794-fddf0cca8b19 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:03.560157 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-027b2d57-c872-4d03-a794-fddf0cca8b19 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:03.561309 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-027b2d57-c872-4d03-a794-fddf0cca8b19 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:03.561764 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-027b2d57-c872-4d03-a794-fddf0cca8b19 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:03.562199 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-027b2d57-c872-4d03-a794-fddf0cca8b19 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:03.634051 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-027b2d57-c872-4d03-a794-fddf0cca8b19 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:10:03.641876 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-027b2d57-c872-4d03-a794-fddf0cca8b19 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8" status: 200 len: 1192 microversion: 2.1 time: 0.095756 Aug 26 16:10:03.642448 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 640/1291] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:10:03 2022] GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8 => generated 1192 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:10:04.664018 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-d42f6988-061b-42be-82fe-8545d35c3a1a tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:10:04.664632 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-d42f6988-061b-42be-82fe-8545d35c3a1a tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 4fff8127-cbc0-47db-abf4-4e5bb5c211e8] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:10:04.671252 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d42f6988-061b-42be-82fe-8545d35c3a1a tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:04.671731 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d42f6988-061b-42be-82fe-8545d35c3a1a tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:04.672354 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d42f6988-061b-42be-82fe-8545d35c3a1a tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:04.673907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d42f6988-061b-42be-82fe-8545d35c3a1a tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:04.674568 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d42f6988-061b-42be-82fe-8545d35c3a1a tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:04.675020 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-d42f6988-061b-42be-82fe-8545d35c3a1a tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:04.951799 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-d42f6988-061b-42be-82fe-8545d35c3a1a tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:10:04.960488 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-d42f6988-061b-42be-82fe-8545d35c3a1a tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8" status: 200 len: 1277 microversion: 2.1 time: 0.300994 Aug 26 16:10:04.961071 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 652/1292] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:10:04 2022] GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8 => generated 1277 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:10:05.438878 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-2d7d13cf-af48-4dd1-b747-a579355eb341 req-6f5babad-435b-4f03-8f7a-b5562e0416ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fff8127-cbc0-47db-abf4-4e5bb5c211e8", "tag": "6b4a2508-789a-48c0-8c44-cc5c0043d9c9"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:10:05.449290 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-2d7d13cf-af48-4dd1-b747-a579355eb341 req-6f5babad-435b-4f03-8f7a-b5562e0416ac service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:05.449760 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-2d7d13cf-af48-4dd1-b747-a579355eb341 req-6f5babad-435b-4f03-8f7a-b5562e0416ac service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:05.450327 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-2d7d13cf-af48-4dd1-b747-a579355eb341 req-6f5babad-435b-4f03-8f7a-b5562e0416ac service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:05.462212 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-2d7d13cf-af48-4dd1-b747-a579355eb341 req-6f5babad-435b-4f03-8f7a-b5562e0416ac service nova] Creating event network-changed:6b4a2508-789a-48c0-8c44-cc5c0043d9c9 for instance 4fff8127-cbc0-47db-abf4-4e5bb5c211e8 on hv-cinder-85144 Aug 26 16:10:05.467210 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-2d7d13cf-af48-4dd1-b747-a579355eb341 req-6f5babad-435b-4f03-8f7a-b5562e0416ac service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032108 Aug 26 16:10:05.467882 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 641/1293] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:10:05.981118 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-cfa4ff13-e596-4bbf-8ccd-289011e0a392 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:10:05.981889 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-cfa4ff13-e596-4bbf-8ccd-289011e0a392 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 4fff8127-cbc0-47db-abf4-4e5bb5c211e8] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:10:05.988311 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cfa4ff13-e596-4bbf-8ccd-289011e0a392 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:05.988788 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cfa4ff13-e596-4bbf-8ccd-289011e0a392 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:05.989415 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cfa4ff13-e596-4bbf-8ccd-289011e0a392 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:05.990694 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cfa4ff13-e596-4bbf-8ccd-289011e0a392 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:05.991247 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cfa4ff13-e596-4bbf-8ccd-289011e0a392 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:05.991599 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-cfa4ff13-e596-4bbf-8ccd-289011e0a392 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:06.480915 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-cfa4ff13-e596-4bbf-8ccd-289011e0a392 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:10:06.492277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-cfa4ff13-e596-4bbf-8ccd-289011e0a392 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8" status: 200 len: 1265 microversion: 2.1 time: 0.511310 Aug 26 16:10:06.492277 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 653/1294] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:10:05 2022] GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8 => generated 1265 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:10:07.511296 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7d42ac54-768e-44b2-b29a-c94f7a7b7e5c tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:10:07.512005 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-7d42ac54-768e-44b2-b29a-c94f7a7b7e5c tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 4fff8127-cbc0-47db-abf4-4e5bb5c211e8] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:10:07.518235 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7d42ac54-768e-44b2-b29a-c94f7a7b7e5c tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:07.518723 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7d42ac54-768e-44b2-b29a-c94f7a7b7e5c tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:07.519197 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7d42ac54-768e-44b2-b29a-c94f7a7b7e5c tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:07.519893 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7d42ac54-768e-44b2-b29a-c94f7a7b7e5c tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:07.520458 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7d42ac54-768e-44b2-b29a-c94f7a7b7e5c tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:07.521667 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7d42ac54-768e-44b2-b29a-c94f7a7b7e5c tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:07.658560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7d42ac54-768e-44b2-b29a-c94f7a7b7e5c tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:10:07.666812 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-7d42ac54-768e-44b2-b29a-c94f7a7b7e5c tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8" status: 200 len: 1265 microversion: 2.1 time: 0.160259 Aug 26 16:10:07.667419 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 642/1295] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:10:07 2022] GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:10:08.687868 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-84f2347c-39fc-4ad8-a579-d6b0acd6b61d tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:10:08.688481 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-84f2347c-39fc-4ad8-a579-d6b0acd6b61d tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 4fff8127-cbc0-47db-abf4-4e5bb5c211e8] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:10:08.695290 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-84f2347c-39fc-4ad8-a579-d6b0acd6b61d tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:08.695794 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-84f2347c-39fc-4ad8-a579-d6b0acd6b61d tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:08.696225 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-84f2347c-39fc-4ad8-a579-d6b0acd6b61d tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:08.696940 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-84f2347c-39fc-4ad8-a579-d6b0acd6b61d tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:08.697387 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-84f2347c-39fc-4ad8-a579-d6b0acd6b61d tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:08.697813 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-84f2347c-39fc-4ad8-a579-d6b0acd6b61d tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:08.827713 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-84f2347c-39fc-4ad8-a579-d6b0acd6b61d tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:10:08.836006 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-84f2347c-39fc-4ad8-a579-d6b0acd6b61d tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8" status: 200 len: 1265 microversion: 2.1 time: 0.152078 Aug 26 16:10:08.836572 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 654/1296] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:10:08 2022] GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:10:09.855738 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-ebe592cc-491d-466e-bb4f-d5a101480d5b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:10:09.856287 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-ebe592cc-491d-466e-bb4f-d5a101480d5b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 4fff8127-cbc0-47db-abf4-4e5bb5c211e8] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:10:09.862693 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebe592cc-491d-466e-bb4f-d5a101480d5b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:09.863270 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebe592cc-491d-466e-bb4f-d5a101480d5b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:09.863707 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebe592cc-491d-466e-bb4f-d5a101480d5b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:09.864454 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebe592cc-491d-466e-bb4f-d5a101480d5b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:09.864993 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebe592cc-491d-466e-bb4f-d5a101480d5b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:09.865416 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-ebe592cc-491d-466e-bb4f-d5a101480d5b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:10.000354 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-ebe592cc-491d-466e-bb4f-d5a101480d5b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:10:10.009310 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-ebe592cc-491d-466e-bb4f-d5a101480d5b tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8" status: 200 len: 1265 microversion: 2.1 time: 0.157545 Aug 26 16:10:10.009876 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 643/1297] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:10:09 2022] GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:10:11.031628 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-7dc585d2-17ad-40bf-83d9-feda3426a144 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:10:11.032266 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-7dc585d2-17ad-40bf-83d9-feda3426a144 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 4fff8127-cbc0-47db-abf4-4e5bb5c211e8] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:10:11.034521 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell0:SELECT=2 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:10:11.035351 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell0:SELECT=6 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:10:11.040241 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7dc585d2-17ad-40bf-83d9-feda3426a144 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:11.043040 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7dc585d2-17ad-40bf-83d9-feda3426a144 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:11.043040 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7dc585d2-17ad-40bf-83d9-feda3426a144 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:11.043040 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7dc585d2-17ad-40bf-83d9-feda3426a144 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:11.043040 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7dc585d2-17ad-40bf-83d9-feda3426a144 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:11.043444 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-7dc585d2-17ad-40bf-83d9-feda3426a144 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:11.173090 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-7dc585d2-17ad-40bf-83d9-feda3426a144 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:10:11.181628 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-7dc585d2-17ad-40bf-83d9-feda3426a144 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8" status: 200 len: 1265 microversion: 2.1 time: 0.153838 Aug 26 16:10:11.182457 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 655/1298] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:10:11 2022] GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:10:12.202593 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-9baa04f6-360f-4546-9c84-99013c2f71c7 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:10:12.203171 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-9baa04f6-360f-4546-9c84-99013c2f71c7 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 4fff8127-cbc0-47db-abf4-4e5bb5c211e8] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:10:12.205287 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell0:SELECT=2 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:10:12.210600 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9baa04f6-360f-4546-9c84-99013c2f71c7 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:12.211116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9baa04f6-360f-4546-9c84-99013c2f71c7 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:12.211548 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9baa04f6-360f-4546-9c84-99013c2f71c7 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:12.212339 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9baa04f6-360f-4546-9c84-99013c2f71c7 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:12.212788 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9baa04f6-360f-4546-9c84-99013c2f71c7 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:12.213206 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-9baa04f6-360f-4546-9c84-99013c2f71c7 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:12.348102 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-9baa04f6-360f-4546-9c84-99013c2f71c7 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:10:12.355920 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-9baa04f6-360f-4546-9c84-99013c2f71c7 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8" status: 200 len: 1265 microversion: 2.1 time: 0.157334 Aug 26 16:10:12.356493 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 644/1299] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:10:12 2022] GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:10:13.377153 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-2064f3c9-0648-4b41-a2a5-9e052deeaddb tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:10:13.377776 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-2064f3c9-0648-4b41-a2a5-9e052deeaddb tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 4fff8127-cbc0-47db-abf4-4e5bb5c211e8] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:10:13.384903 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2064f3c9-0648-4b41-a2a5-9e052deeaddb tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:13.385455 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2064f3c9-0648-4b41-a2a5-9e052deeaddb tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:13.385894 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2064f3c9-0648-4b41-a2a5-9e052deeaddb tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:13.386591 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2064f3c9-0648-4b41-a2a5-9e052deeaddb tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:13.387071 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2064f3c9-0648-4b41-a2a5-9e052deeaddb tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:13.387520 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2064f3c9-0648-4b41-a2a5-9e052deeaddb tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:13.519342 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-2064f3c9-0648-4b41-a2a5-9e052deeaddb tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:10:13.527638 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-2064f3c9-0648-4b41-a2a5-9e052deeaddb tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8" status: 200 len: 1265 microversion: 2.1 time: 0.154498 Aug 26 16:10:13.528210 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 656/1300] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:10:13 2022] GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:10:14.548285 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-912159a8-3793-4b84-accd-66b5834987c3 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:10:14.548897 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-912159a8-3793-4b84-accd-66b5834987c3 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 4fff8127-cbc0-47db-abf4-4e5bb5c211e8] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:10:14.555490 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-912159a8-3793-4b84-accd-66b5834987c3 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:14.555973 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-912159a8-3793-4b84-accd-66b5834987c3 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:14.556411 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-912159a8-3793-4b84-accd-66b5834987c3 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:14.557368 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-912159a8-3793-4b84-accd-66b5834987c3 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:14.557824 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-912159a8-3793-4b84-accd-66b5834987c3 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:14.558251 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-912159a8-3793-4b84-accd-66b5834987c3 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:14.693322 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-912159a8-3793-4b84-accd-66b5834987c3 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:10:14.701065 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-912159a8-3793-4b84-accd-66b5834987c3 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8" status: 200 len: 1265 microversion: 2.1 time: 0.156646 Aug 26 16:10:14.701614 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 645/1301] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:10:14 2022] GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:10:15.722565 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-4585cfa2-bc67-4dcb-8d53-eef9a934aa84 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:10:15.722565 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-4585cfa2-bc67-4dcb-8d53-eef9a934aa84 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 4fff8127-cbc0-47db-abf4-4e5bb5c211e8] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:10:15.729376 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4585cfa2-bc67-4dcb-8d53-eef9a934aa84 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:15.729864 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4585cfa2-bc67-4dcb-8d53-eef9a934aa84 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:15.730300 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4585cfa2-bc67-4dcb-8d53-eef9a934aa84 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:15.731021 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4585cfa2-bc67-4dcb-8d53-eef9a934aa84 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:15.731476 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4585cfa2-bc67-4dcb-8d53-eef9a934aa84 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:15.731902 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-4585cfa2-bc67-4dcb-8d53-eef9a934aa84 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:15.867443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-4585cfa2-bc67-4dcb-8d53-eef9a934aa84 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:10:15.875087 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-4585cfa2-bc67-4dcb-8d53-eef9a934aa84 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8" status: 200 len: 1265 microversion: 2.1 time: 0.157354 Aug 26 16:10:15.875862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 657/1302] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:10:15 2022] GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:10:16.896203 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-5f664682-14d7-403f-ba1c-b9aad82d2995 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:10:16.896814 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-5f664682-14d7-403f-ba1c-b9aad82d2995 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 4fff8127-cbc0-47db-abf4-4e5bb5c211e8] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:10:16.903253 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5f664682-14d7-403f-ba1c-b9aad82d2995 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:16.903735 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5f664682-14d7-403f-ba1c-b9aad82d2995 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:16.904170 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5f664682-14d7-403f-ba1c-b9aad82d2995 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:16.904859 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5f664682-14d7-403f-ba1c-b9aad82d2995 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:16.905315 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5f664682-14d7-403f-ba1c-b9aad82d2995 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:16.905742 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5f664682-14d7-403f-ba1c-b9aad82d2995 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:17.036434 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-5f664682-14d7-403f-ba1c-b9aad82d2995 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:10:17.044070 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-5f664682-14d7-403f-ba1c-b9aad82d2995 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8" status: 200 len: 1265 microversion: 2.1 time: 0.152130 Aug 26 16:10:17.044643 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 646/1303] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:10:16 2022] GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:10:17.746330 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-e0b34929-aa3d-42c5-93ba-674ed80150c7 req-421571ef-a5e1-4929-91ab-c3e5ad264194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fff8127-cbc0-47db-abf4-4e5bb5c211e8", "name": "network-vif-plugged", "status": "completed", "tag": "6b4a2508-789a-48c0-8c44-cc5c0043d9c9"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:10:17.757240 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-e0b34929-aa3d-42c5-93ba-674ed80150c7 req-421571ef-a5e1-4929-91ab-c3e5ad264194 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:17.757905 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-e0b34929-aa3d-42c5-93ba-674ed80150c7 req-421571ef-a5e1-4929-91ab-c3e5ad264194 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:17.758353 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-e0b34929-aa3d-42c5-93ba-674ed80150c7 req-421571ef-a5e1-4929-91ab-c3e5ad264194 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:17.769551 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-e0b34929-aa3d-42c5-93ba-674ed80150c7 req-421571ef-a5e1-4929-91ab-c3e5ad264194 service nova] Creating event network-vif-plugged:6b4a2508-789a-48c0-8c44-cc5c0043d9c9 for instance 4fff8127-cbc0-47db-abf4-4e5bb5c211e8 on hv-cinder-85144 Aug 26 16:10:17.775721 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-e0b34929-aa3d-42c5-93ba-674ed80150c7 req-421571ef-a5e1-4929-91ab-c3e5ad264194 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033114 Aug 26 16:10:17.776334 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 658/1304] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:10:18.065397 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7001d3ec-ff39-4eaa-905d-8da89fcd4be8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:10:18.066013 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-7001d3ec-ff39-4eaa-905d-8da89fcd4be8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 4fff8127-cbc0-47db-abf4-4e5bb5c211e8] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:10:18.073141 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7001d3ec-ff39-4eaa-905d-8da89fcd4be8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:18.076242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7001d3ec-ff39-4eaa-905d-8da89fcd4be8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:18.076242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7001d3ec-ff39-4eaa-905d-8da89fcd4be8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:18.076242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7001d3ec-ff39-4eaa-905d-8da89fcd4be8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:18.076242 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7001d3ec-ff39-4eaa-905d-8da89fcd4be8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:18.076671 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7001d3ec-ff39-4eaa-905d-8da89fcd4be8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:18.260773 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-7001d3ec-ff39-4eaa-905d-8da89fcd4be8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:10:18.268456 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-7001d3ec-ff39-4eaa-905d-8da89fcd4be8 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8" status: 200 len: 1265 microversion: 2.1 time: 0.206999 Aug 26 16:10:18.269021 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 647/1305] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:10:18 2022] GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8 => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:10:19.290205 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-527db7c6-abc9-4ac7-8820-3f65aa1f3b9f tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:10:19.290911 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-527db7c6-abc9-4ac7-8820-3f65aa1f3b9f tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 4fff8127-cbc0-47db-abf4-4e5bb5c211e8] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:10:19.297054 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-527db7c6-abc9-4ac7-8820-3f65aa1f3b9f tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:19.299608 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-527db7c6-abc9-4ac7-8820-3f65aa1f3b9f tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:19.299608 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-527db7c6-abc9-4ac7-8820-3f65aa1f3b9f tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:19.299608 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-527db7c6-abc9-4ac7-8820-3f65aa1f3b9f tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:19.299608 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-527db7c6-abc9-4ac7-8820-3f65aa1f3b9f tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:19.300010 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-527db7c6-abc9-4ac7-8820-3f65aa1f3b9f tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:19.438419 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-527db7c6-abc9-4ac7-8820-3f65aa1f3b9f tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:10:19.446808 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-527db7c6-abc9-4ac7-8820-3f65aa1f3b9f tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8" status: 200 len: 1265 microversion: 2.1 time: 0.162022 Aug 26 16:10:19.447433 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 659/1306] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:10:19 2022] GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:10:20.468318 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-05209ba9-2f78-4e5f-98cf-256c55024eff tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:10:20.468903 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-05209ba9-2f78-4e5f-98cf-256c55024eff tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 4fff8127-cbc0-47db-abf4-4e5bb5c211e8] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:10:20.476218 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-05209ba9-2f78-4e5f-98cf-256c55024eff tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:20.476723 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-05209ba9-2f78-4e5f-98cf-256c55024eff tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:20.477152 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-05209ba9-2f78-4e5f-98cf-256c55024eff tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:20.477836 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-05209ba9-2f78-4e5f-98cf-256c55024eff tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:20.478288 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-05209ba9-2f78-4e5f-98cf-256c55024eff tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:20.478706 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-05209ba9-2f78-4e5f-98cf-256c55024eff tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:20.608942 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-05209ba9-2f78-4e5f-98cf-256c55024eff tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:10:20.616801 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-05209ba9-2f78-4e5f-98cf-256c55024eff tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8" status: 200 len: 1452 microversion: 2.1 time: 0.152371 Aug 26 16:10:20.617370 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 648/1307] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:10:20 2022] GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:10:20.636732 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-2a33518e-6a8a-4b8b-bd2b-550e780864d3 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:10:20.637367 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-2a33518e-6a8a-4b8b-bd2b-550e780864d3 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 4fff8127-cbc0-47db-abf4-4e5bb5c211e8] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:10:20.643760 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2a33518e-6a8a-4b8b-bd2b-550e780864d3 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:20.644239 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2a33518e-6a8a-4b8b-bd2b-550e780864d3 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:20.644676 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2a33518e-6a8a-4b8b-bd2b-550e780864d3 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:20.645950 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2a33518e-6a8a-4b8b-bd2b-550e780864d3 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:20.646397 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2a33518e-6a8a-4b8b-bd2b-550e780864d3 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:20.646822 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2a33518e-6a8a-4b8b-bd2b-550e780864d3 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:20.774553 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-2a33518e-6a8a-4b8b-bd2b-550e780864d3 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:10:20.782134 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-2a33518e-6a8a-4b8b-bd2b-550e780864d3 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8" status: 200 len: 1452 microversion: 2.1 time: 0.149189 Aug 26 16:10:20.782688 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 660/1308] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:10:20 2022] GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:10:22.661126 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-098cbdfe-edb1-4853-b9a5-4f685d6c21e6 req-f5ff75a0-7f03-4230-a979-909c7fa0e293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fff8127-cbc0-47db-abf4-4e5bb5c211e8", "tag": "6b4a2508-789a-48c0-8c44-cc5c0043d9c9"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:10:22.671188 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-098cbdfe-edb1-4853-b9a5-4f685d6c21e6 req-f5ff75a0-7f03-4230-a979-909c7fa0e293 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:10:22.677184 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-098cbdfe-edb1-4853-b9a5-4f685d6c21e6 req-f5ff75a0-7f03-4230-a979-909c7fa0e293 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:10:22.677184 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-098cbdfe-edb1-4853-b9a5-4f685d6c21e6 req-f5ff75a0-7f03-4230-a979-909c7fa0e293 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:10:22.683409 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-098cbdfe-edb1-4853-b9a5-4f685d6c21e6 req-f5ff75a0-7f03-4230-a979-909c7fa0e293 service nova] Creating event network-changed:6b4a2508-789a-48c0-8c44-cc5c0043d9c9 for instance 4fff8127-cbc0-47db-abf4-4e5bb5c211e8 on hv-cinder-85144 Aug 26 16:10:22.688494 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-098cbdfe-edb1-4853-b9a5-4f685d6c21e6 req-f5ff75a0-7f03-4230-a979-909c7fa0e293 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031159 Aug 26 16:10:22.689366 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 649/1309] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:11:50.511791 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:11:50.515624 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_api:SELECT=24 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:11:50.517394 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG dbcounter [-] [128305] Writing DB stats nova_cell1:SELECT=58 {{(pid=128305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:11:50.522081 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-f996219c-f60e-4ed1-afe4-a16240e93413 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:11:50.522576 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-f996219c-f60e-4ed1-afe4-a16240e93413 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 4fff8127-cbc0-47db-abf4-4e5bb5c211e8] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:11:50.525826 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG dbcounter [-] [128304] Writing DB stats nova_cell1:SELECT=52 {{(pid=128304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 16:11:50.527240 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 16:11:50.527386 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Fri Aug 26 16:11:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.94) !!! Aug 26 16:11:50.530907 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f996219c-f60e-4ed1-afe4-a16240e93413 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:11:50.531427 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f996219c-f60e-4ed1-afe4-a16240e93413 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:11:50.531884 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f996219c-f60e-4ed1-afe4-a16240e93413 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:11:50.532822 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f996219c-f60e-4ed1-afe4-a16240e93413 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:11:50.533272 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f996219c-f60e-4ed1-afe4-a16240e93413 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:11:50.533404 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-11447854-e645-4cde-b213-63d8527043ff req-4e54e8a1-85b2-4a7b-aa63-ebd38108fc30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fff8127-cbc0-47db-abf4-4e5bb5c211e8", "tag": "6b4a2508-789a-48c0-8c44-cc5c0043d9c9"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:11:50.533771 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-f996219c-f60e-4ed1-afe4-a16240e93413 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:11:50.544110 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-11447854-e645-4cde-b213-63d8527043ff req-4e54e8a1-85b2-4a7b-aa63-ebd38108fc30 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:11:50.544588 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-11447854-e645-4cde-b213-63d8527043ff req-4e54e8a1-85b2-4a7b-aa63-ebd38108fc30 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:11:50.545017 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-11447854-e645-4cde-b213-63d8527043ff req-4e54e8a1-85b2-4a7b-aa63-ebd38108fc30 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:11:50.557924 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-11447854-e645-4cde-b213-63d8527043ff req-4e54e8a1-85b2-4a7b-aa63-ebd38108fc30 service nova] Creating event network-changed:6b4a2508-789a-48c0-8c44-cc5c0043d9c9 for instance 4fff8127-cbc0-47db-abf4-4e5bb5c211e8 on hv-cinder-85144 Aug 26 16:11:50.561453 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-f996219c-f60e-4ed1-afe4-a16240e93413 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 4fff8127-cbc0-47db-abf4-4e5bb5c211e8] Going to try to terminate instance {{(pid=128305) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 16:11:50.570116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-11447854-e645-4cde-b213-63d8527043ff req-4e54e8a1-85b2-4a7b-aa63-ebd38108fc30 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056459 Aug 26 16:11:50.571735 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 650/1310] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:11:50.951994 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-f996219c-f60e-4ed1-afe4-a16240e93413 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "DELETE /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8" status: 204 len: 0 microversion: 2.1 time: 0.441539 Aug 26 16:11:50.952866 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 661/1311] 10.222.0.94 () {58 vars in 1239 bytes} [Fri Aug 26 16:11:50 2022] DELETE /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 16:11:50.962713 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-23844887-ddcd-49b1-a6c6-6454ba67d890 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:11:50.963084 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-23844887-ddcd-49b1-a6c6-6454ba67d890 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 4fff8127-cbc0-47db-abf4-4e5bb5c211e8] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:11:50.970163 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-23844887-ddcd-49b1-a6c6-6454ba67d890 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:11:50.970716 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-23844887-ddcd-49b1-a6c6-6454ba67d890 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:11:50.971492 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-23844887-ddcd-49b1-a6c6-6454ba67d890 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:11:50.972065 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-23844887-ddcd-49b1-a6c6-6454ba67d890 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:11:50.972505 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-23844887-ddcd-49b1-a6c6-6454ba67d890 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:11:50.972938 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-23844887-ddcd-49b1-a6c6-6454ba67d890 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:11:51.162387 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-23844887-ddcd-49b1-a6c6-6454ba67d890 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:11:51.171433 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-23844887-ddcd-49b1-a6c6-6454ba67d890 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8" status: 200 len: 1576 microversion: 2.1 time: 0.213959 Aug 26 16:11:51.172016 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 651/1312] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:11:50 2022] GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8 => generated 1576 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 16:11:52.193435 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-b8921cf0-48d3-4c77-ac3e-34a08a8380e0 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:11:52.194143 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-b8921cf0-48d3-4c77-ac3e-34a08a8380e0 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 4fff8127-cbc0-47db-abf4-4e5bb5c211e8] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:11:52.201253 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b8921cf0-48d3-4c77-ac3e-34a08a8380e0 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:11:52.205957 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b8921cf0-48d3-4c77-ac3e-34a08a8380e0 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:11:52.205957 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b8921cf0-48d3-4c77-ac3e-34a08a8380e0 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:11:52.205957 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b8921cf0-48d3-4c77-ac3e-34a08a8380e0 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:11:52.205957 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b8921cf0-48d3-4c77-ac3e-34a08a8380e0 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:11:52.206443 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-b8921cf0-48d3-4c77-ac3e-34a08a8380e0 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:11:52.673587 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-b8921cf0-48d3-4c77-ac3e-34a08a8380e0 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:11:52.681568 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-b8921cf0-48d3-4c77-ac3e-34a08a8380e0 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8" status: 200 len: 1576 microversion: 2.1 time: 0.492423 Aug 26 16:11:52.684206 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 662/1313] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:11:52 2022] GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8 => generated 1576 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:11:53.329626 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-fab52e1a-fce2-4d65-b86f-75bae36fc90c req-2a4896c5-e2cf-45f2-ab7d-582444e86ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fff8127-cbc0-47db-abf4-4e5bb5c211e8", "name": "network-vif-deleted", "tag": "6b4a2508-789a-48c0-8c44-cc5c0043d9c9"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:11:53.339922 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-fab52e1a-fce2-4d65-b86f-75bae36fc90c req-2a4896c5-e2cf-45f2-ab7d-582444e86ce3 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:11:53.340390 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-fab52e1a-fce2-4d65-b86f-75bae36fc90c req-2a4896c5-e2cf-45f2-ab7d-582444e86ce3 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:11:53.340816 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-fab52e1a-fce2-4d65-b86f-75bae36fc90c req-2a4896c5-e2cf-45f2-ab7d-582444e86ce3 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:11:53.352818 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-fab52e1a-fce2-4d65-b86f-75bae36fc90c req-2a4896c5-e2cf-45f2-ab7d-582444e86ce3 service nova] Creating event network-vif-deleted:6b4a2508-789a-48c0-8c44-cc5c0043d9c9 for instance 4fff8127-cbc0-47db-abf4-4e5bb5c211e8 on hv-cinder-85144 Aug 26 16:11:53.357703 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-fab52e1a-fce2-4d65-b86f-75bae36fc90c req-2a4896c5-e2cf-45f2-ab7d-582444e86ce3 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031940 Aug 26 16:11:53.358272 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 652/1314] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:11:53.704363 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-9fc7c3d9-c1d4-4382-b3c6-4c3f2351257f tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:11:53.705058 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-9fc7c3d9-c1d4-4382-b3c6-4c3f2351257f tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 4fff8127-cbc0-47db-abf4-4e5bb5c211e8] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:11:53.711961 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9fc7c3d9-c1d4-4382-b3c6-4c3f2351257f tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:11:53.712448 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9fc7c3d9-c1d4-4382-b3c6-4c3f2351257f tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:11:53.712884 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9fc7c3d9-c1d4-4382-b3c6-4c3f2351257f tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:11:53.713595 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9fc7c3d9-c1d4-4382-b3c6-4c3f2351257f tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:11:53.714117 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9fc7c3d9-c1d4-4382-b3c6-4c3f2351257f tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:11:53.714546 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-9fc7c3d9-c1d4-4382-b3c6-4c3f2351257f tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:11:53.780579 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-9fc7c3d9-c1d4-4382-b3c6-4c3f2351257f tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:11:53.789044 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-9fc7c3d9-c1d4-4382-b3c6-4c3f2351257f tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8" status: 200 len: 1225 microversion: 2.1 time: 0.089118 Aug 26 16:11:53.789809 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 663/1315] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:11:53 2022] GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:11:54.810476 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-5d7535ba-ecc7-4092-8cec-e04b75fe2e30 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:11:54.811237 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-5d7535ba-ecc7-4092-8cec-e04b75fe2e30 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 4fff8127-cbc0-47db-abf4-4e5bb5c211e8] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:11:54.817561 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d7535ba-ecc7-4092-8cec-e04b75fe2e30 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:11:54.818044 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d7535ba-ecc7-4092-8cec-e04b75fe2e30 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:11:54.818483 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d7535ba-ecc7-4092-8cec-e04b75fe2e30 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:11:54.819212 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d7535ba-ecc7-4092-8cec-e04b75fe2e30 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:11:54.819677 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d7535ba-ecc7-4092-8cec-e04b75fe2e30 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:11:54.820105 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-5d7535ba-ecc7-4092-8cec-e04b75fe2e30 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:11:54.833660 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-5d7535ba-ecc7-4092-8cec-e04b75fe2e30 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] HTTP exception thrown: Instance 4fff8127-cbc0-47db-abf4-4e5bb5c211e8 could not be found. Aug 26 16:11:54.835244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-5d7535ba-ecc7-4092-8cec-e04b75fe2e30 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Request method failure captured: Aug 26 16:11:54.835244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8 HTTP/1.1 Aug 26 16:11:54.835244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 16:11:54.835244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 16:11:54.835244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 16:11:54.835244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 0 Aug 26 16:11:54.835244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 16:11:54.835244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 16:11:54.835244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 16:11:54.835244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 16:11:54.835244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO8kiDWM4vhVznoXwfR9MMqhXaAnXUM95N_VAGU8nUUvtlCXIPXxN2iNqstvUcM-VsO6rKcNS7Z80z_7oU4-jvse06U0FbaOF9gM4jljvLmV92GQj2QdWvoh7QTsLYK9UxEEA53VHKXRDgKFtbUwU9IvHnZxayI1b7d1-ia-ZnyaJw8 Aug 26 16:11:54.835244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 16:11:54.835244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 16:11:54.835244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 16:11:54.835244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 16:11:54.835244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 16:11:54.835244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 16:11:54.835244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: 3c5f0e0c02e64047b9ca17a7320b0bf5 Aug 26 16:11:54.835244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-TestVolumeBootPattern-1888948582 Aug 26 16:11:54.835244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 16:11:54.835244 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 16:11:54.837040 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3c5f0e0c02e64047b9ca17a7320b0bf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/3c5f0e0c02e64047b9ca17a7320b0bf5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3c5f0e0c02e64047b9ca17a7320b0bf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_3c5f0e0c02e64047b9ca17a7320b0bf5", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:11:54.837040 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-TestVolumeBootPattern-1888948582 Aug 26 16:11:54.837040 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: 3c5f0e0c02e64047b9ca17a7320b0bf5 Aug 26 16:11:54.837040 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-TestVolumeBootPattern-1888948582 Aug 26 16:11:54.837040 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-TestVolumeBootPattern-1888948582-project Aug 26 16:11:54.837040 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 16:11:54.837040 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 16:11:54.837040 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: c911a9324cb744a6a1aeb068565d3f89 Aug 26 16:11:54.837040 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-TestVolumeBootPattern-1888948582-project Aug 26 16:11:54.837040 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: > Aug 26 16:11:54.837040 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Instance 4fff8127-cbc0-47db-abf4-4e5bb5c211e8 could not be found. Aug 26 16:11:54.837040 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'id': '4fff8127-cbc0-47db-abf4-4e5bb5c211e8'} Aug 26 16:11:54.838060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:11:54.838060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:11:54.838060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:11:54.838060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:11:54.838060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:11:54.838060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:11:54.838060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:11:54.838060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:11:54.838060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:11:54.838060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:11:54.838060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fff8127-cbc0-47db-abf4-4e5bb5c211e8 could not be found. Aug 26 16:11:54.838060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:11:54.838060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:11:54.838060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:11:54.838060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:11:54.838060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:11:54.838060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:11:54.838060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:11:54.838060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:11:54.838060 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:11:54.841200 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:11:54.841200 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:11:54.841200 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:11:54.841200 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:11:54.841200 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:11:54.841200 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:11:54.841200 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:11:54.841200 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fff8127-cbc0-47db-abf4-4e5bb5c211e8 could not be found. Aug 26 16:11:54.841200 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:11:54.841200 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:11:54.841200 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:11:54.841200 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:11:54.841200 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:11:54.841200 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:11:54.841200 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:11:54.841200 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:11:54.841200 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fff8127-cbc0-47db-abf4-4e5bb5c211e8 could not be found. Aug 26 16:11:54.841200 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:11:54.842469 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-5d7535ba-ecc7-4092-8cec-e04b75fe2e30 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Returning 404 to user: Instance 4fff8127-cbc0-47db-abf4-4e5bb5c211e8 could not be found. {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:11:54.842469 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-5d7535ba-ecc7-4092-8cec-e04b75fe2e30 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8" status: 404 len: 111 microversion: 2.1 time: 0.031194 Aug 26 16:11:54.842469 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 653/1316] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:11:54 2022] GET /compute/v2.1/servers/4fff8127-cbc0-47db-abf4-4e5bb5c211e8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:11:58.333528 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-84dd4e5f-7fb1-4cb1-9195-549067a64328 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:11:58.334263 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-84dd4e5f-7fb1-4cb1-9195-549067a64328 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 53e773e1-f20a-476e-80a4-d6b769ee4004] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:11:58.336079 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [req-6828dddb-2645-446f-b31e-5b1eae290add req-ab3d0edd-1c39-461f-8500-5764e078bc4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53e773e1-f20a-476e-80a4-d6b769ee4004", "tag": "9bcbb986-ec78-4b94-886b-b800f34b40eb"}]} {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:11:58.341965 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-84dd4e5f-7fb1-4cb1-9195-549067a64328 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:11:58.342694 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-84dd4e5f-7fb1-4cb1-9195-549067a64328 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:11:58.343165 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-84dd4e5f-7fb1-4cb1-9195-549067a64328 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:11:58.343865 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-84dd4e5f-7fb1-4cb1-9195-549067a64328 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:11:58.345406 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-84dd4e5f-7fb1-4cb1-9195-549067a64328 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:11:58.346074 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-84dd4e5f-7fb1-4cb1-9195-549067a64328 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:11:58.346609 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-6828dddb-2645-446f-b31e-5b1eae290add req-ab3d0edd-1c39-461f-8500-5764e078bc4b service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:11:58.347108 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-6828dddb-2645-446f-b31e-5b1eae290add req-ab3d0edd-1c39-461f-8500-5764e078bc4b service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:11:58.347538 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [req-6828dddb-2645-446f-b31e-5b1eae290add req-ab3d0edd-1c39-461f-8500-5764e078bc4b service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:11:58.359168 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.compute.server_external_events [req-6828dddb-2645-446f-b31e-5b1eae290add req-ab3d0edd-1c39-461f-8500-5764e078bc4b service nova] Creating event network-changed:9bcbb986-ec78-4b94-886b-b800f34b40eb for instance 53e773e1-f20a-476e-80a4-d6b769ee4004 on hv-cinder-85144 Aug 26 16:11:58.366560 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [req-6828dddb-2645-446f-b31e-5b1eae290add req-ab3d0edd-1c39-461f-8500-5764e078bc4b service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033624 Aug 26 16:11:58.367823 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 654/1317] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 16:11:58.376053 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-84dd4e5f-7fb1-4cb1-9195-549067a64328 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 53e773e1-f20a-476e-80a4-d6b769ee4004] Going to try to terminate instance {{(pid=128305) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 16:11:58.822155 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-84dd4e5f-7fb1-4cb1-9195-549067a64328 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "DELETE /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004" status: 204 len: 0 microversion: 2.1 time: 0.481283 Aug 26 16:11:58.822155 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 664/1318] 10.222.0.94 () {58 vars in 1239 bytes} [Fri Aug 26 16:11:58 2022] DELETE /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 16:11:58.822654 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-99ec09ef-bafc-4371-bea3-fcfb59151a3d tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:11:58.822654 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-99ec09ef-bafc-4371-bea3-fcfb59151a3d tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 53e773e1-f20a-476e-80a4-d6b769ee4004] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:11:58.828125 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-99ec09ef-bafc-4371-bea3-fcfb59151a3d tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:11:58.829141 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-99ec09ef-bafc-4371-bea3-fcfb59151a3d tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:11:58.829577 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-99ec09ef-bafc-4371-bea3-fcfb59151a3d tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:11:58.830277 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-99ec09ef-bafc-4371-bea3-fcfb59151a3d tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:11:58.830732 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-99ec09ef-bafc-4371-bea3-fcfb59151a3d tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:11:58.831190 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-99ec09ef-bafc-4371-bea3-fcfb59151a3d tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:11:58.972749 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-99ec09ef-bafc-4371-bea3-fcfb59151a3d tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:11:58.980571 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-99ec09ef-bafc-4371-bea3-fcfb59151a3d tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004" status: 200 len: 1575 microversion: 2.1 time: 0.164123 Aug 26 16:11:58.982858 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 655/1319] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:11:58 2022] GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:12:00.002594 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-2b8fbb9b-8249-442c-b6d0-30fa94e616e7 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:12:00.003241 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-2b8fbb9b-8249-442c-b6d0-30fa94e616e7 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 53e773e1-f20a-476e-80a4-d6b769ee4004] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:12:00.009537 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2b8fbb9b-8249-442c-b6d0-30fa94e616e7 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:12:00.010021 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2b8fbb9b-8249-442c-b6d0-30fa94e616e7 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:12:00.010481 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2b8fbb9b-8249-442c-b6d0-30fa94e616e7 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:12:00.011202 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2b8fbb9b-8249-442c-b6d0-30fa94e616e7 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:12:00.011698 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2b8fbb9b-8249-442c-b6d0-30fa94e616e7 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:12:00.012124 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-2b8fbb9b-8249-442c-b6d0-30fa94e616e7 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:12:00.151200 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-2b8fbb9b-8249-442c-b6d0-30fa94e616e7 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:12:00.160311 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-2b8fbb9b-8249-442c-b6d0-30fa94e616e7 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004" status: 200 len: 1575 microversion: 2.1 time: 0.162587 Aug 26 16:12:00.160887 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 665/1320] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:11:59 2022] GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:12:01.183404 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [req-b0a4b971-e94d-4e19-a86b-6d2623e46308 req-6e08c418-87b4-418b-8988-7df27cda3241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53e773e1-f20a-476e-80a4-d6b769ee4004", "name": "network-vif-deleted", "tag": "9bcbb986-ec78-4b94-886b-b800f34b40eb"}]} {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 16:12:01.184067 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-4f567fc9-683f-4eb8-ab12-908b71d42224 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:12:01.184447 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-4f567fc9-683f-4eb8-ab12-908b71d42224 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 53e773e1-f20a-476e-80a4-d6b769ee4004] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:12:01.191146 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4f567fc9-683f-4eb8-ab12-908b71d42224 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:12:01.191772 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4f567fc9-683f-4eb8-ab12-908b71d42224 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:12:01.192481 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4f567fc9-683f-4eb8-ab12-908b71d42224 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:12:01.193270 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4f567fc9-683f-4eb8-ab12-908b71d42224 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:12:01.193776 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-b0a4b971-e94d-4e19-a86b-6d2623e46308 req-6e08c418-87b4-418b-8988-7df27cda3241 service nova] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:12:01.193910 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4f567fc9-683f-4eb8-ab12-908b71d42224 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:12:01.194215 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-4f567fc9-683f-4eb8-ab12-908b71d42224 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:12:01.194322 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-b0a4b971-e94d-4e19-a86b-6d2623e46308 req-6e08c418-87b4-418b-8988-7df27cda3241 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:12:01.194756 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [req-b0a4b971-e94d-4e19-a86b-6d2623e46308 req-6e08c418-87b4-418b-8988-7df27cda3241 service nova] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:12:01.206637 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.compute.server_external_events [req-b0a4b971-e94d-4e19-a86b-6d2623e46308 req-6e08c418-87b4-418b-8988-7df27cda3241 service nova] Creating event network-vif-deleted:9bcbb986-ec78-4b94-886b-b800f34b40eb for instance 53e773e1-f20a-476e-80a4-d6b769ee4004 on hv-cinder-85144 Aug 26 16:12:01.212112 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [req-b0a4b971-e94d-4e19-a86b-6d2623e46308 req-6e08c418-87b4-418b-8988-7df27cda3241 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032216 Aug 26 16:12:01.212894 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 666/1321] 10.222.0.94 () {64 vars in 1317 bytes} [Fri Aug 26 16:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 16:12:01.266638 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.policy [None req-4f567fc9-683f-4eb8-ab12-908b71d42224 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128304) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:12:01.274699 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-4f567fc9-683f-4eb8-ab12-908b71d42224 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004" status: 200 len: 1390 microversion: 2.1 time: 0.095005 Aug 26 16:12:01.275388 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 656/1322] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:12:01 2022] GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004 => generated 1390 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:12:02.297068 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-8a0bb9b8-0de9-400b-863b-1a7d27151122 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:12:02.297801 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-8a0bb9b8-0de9-400b-863b-1a7d27151122 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 53e773e1-f20a-476e-80a4-d6b769ee4004] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:12:02.304559 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8a0bb9b8-0de9-400b-863b-1a7d27151122 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:12:02.305044 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8a0bb9b8-0de9-400b-863b-1a7d27151122 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:12:02.305480 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8a0bb9b8-0de9-400b-863b-1a7d27151122 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:12:02.306170 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8a0bb9b8-0de9-400b-863b-1a7d27151122 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:12:02.306651 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8a0bb9b8-0de9-400b-863b-1a7d27151122 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:12:02.307107 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8a0bb9b8-0de9-400b-863b-1a7d27151122 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:12:02.338806 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8a0bb9b8-0de9-400b-863b-1a7d27151122 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:12:02.339351 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8a0bb9b8-0de9-400b-863b-1a7d27151122 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:12:02.339789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-8a0bb9b8-0de9-400b-863b-1a7d27151122 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:12:02.340235 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.objects.instance [None req-8a0bb9b8-0de9-400b-863b-1a7d27151122 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lazy-loading 'fault' on Instance uuid 53e773e1-f20a-476e-80a4-d6b769ee4004 {{(pid=128305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 16:12:02.382536 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.policy [None req-8a0bb9b8-0de9-400b-863b-1a7d27151122 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c911a9324cb744a6a1aeb068565d3f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5f0e0c02e64047b9ca17a7320b0bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128305) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 16:12:02.390330 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-8a0bb9b8-0de9-400b-863b-1a7d27151122 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004" status: 200 len: 1230 microversion: 2.1 time: 0.097447 Aug 26 16:12:02.391009 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 667/1323] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:12:02 2022] GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004 => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 16:12:03.412661 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-cb2af7eb-c91e-4e4f-8115-6d8fe9525975 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:12:03.413255 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-cb2af7eb-c91e-4e4f-8115-6d8fe9525975 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 53e773e1-f20a-476e-80a4-d6b769ee4004] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:12:03.420274 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cb2af7eb-c91e-4e4f-8115-6d8fe9525975 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:12:03.420740 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cb2af7eb-c91e-4e4f-8115-6d8fe9525975 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:12:03.421179 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cb2af7eb-c91e-4e4f-8115-6d8fe9525975 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:12:03.421899 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cb2af7eb-c91e-4e4f-8115-6d8fe9525975 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:12:03.422482 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cb2af7eb-c91e-4e4f-8115-6d8fe9525975 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:12:03.422909 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-cb2af7eb-c91e-4e4f-8115-6d8fe9525975 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:12:03.436763 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-cb2af7eb-c91e-4e4f-8115-6d8fe9525975 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] HTTP exception thrown: Instance 53e773e1-f20a-476e-80a4-d6b769ee4004 could not be found. Aug 26 16:12:03.438556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-cb2af7eb-c91e-4e4f-8115-6d8fe9525975 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Request method failure captured: Aug 26 16:12:03.438556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004 HTTP/1.1 Aug 26 16:12:03.438556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 16:12:03.438556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 16:12:03.438556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 16:12:03.438556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 0 Aug 26 16:12:03.438556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 16:12:03.438556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 16:12:03.438556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 16:12:03.438556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 16:12:03.438556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO8kiDWM4vhVznoXwfR9MMqhXaAnXUM95N_VAGU8nUUvtlCXIPXxN2iNqstvUcM-VsO6rKcNS7Z80z_7oU4-jvse06U0FbaOF9gM4jljvLmV92GQj2QdWvoh7QTsLYK9UxEEA53VHKXRDgKFtbUwU9IvHnZxayI1b7d1-ia-ZnyaJw8 Aug 26 16:12:03.438556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 16:12:03.438556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 16:12:03.438556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 16:12:03.438556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 16:12:03.438556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 16:12:03.438556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 16:12:03.438556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: 3c5f0e0c02e64047b9ca17a7320b0bf5 Aug 26 16:12:03.438556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-TestVolumeBootPattern-1888948582 Aug 26 16:12:03.438556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 16:12:03.438556 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 16:12:03.440534 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3c5f0e0c02e64047b9ca17a7320b0bf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/3c5f0e0c02e64047b9ca17a7320b0bf5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3c5f0e0c02e64047b9ca17a7320b0bf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_3c5f0e0c02e64047b9ca17a7320b0bf5", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:12:03.440534 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-TestVolumeBootPattern-1888948582 Aug 26 16:12:03.440534 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: 3c5f0e0c02e64047b9ca17a7320b0bf5 Aug 26 16:12:03.440534 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-TestVolumeBootPattern-1888948582 Aug 26 16:12:03.440534 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-TestVolumeBootPattern-1888948582-project Aug 26 16:12:03.440534 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 16:12:03.440534 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 16:12:03.440534 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: c911a9324cb744a6a1aeb068565d3f89 Aug 26 16:12:03.440534 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-TestVolumeBootPattern-1888948582-project Aug 26 16:12:03.440534 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: > Aug 26 16:12:03.440534 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Instance 53e773e1-f20a-476e-80a4-d6b769ee4004 could not be found. Aug 26 16:12:03.440534 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'id': '53e773e1-f20a-476e-80a4-d6b769ee4004'} Aug 26 16:12:03.441573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:12:03.441573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:12:03.441573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:12:03.441573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:12:03.441573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:12:03.441573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:12:03.441573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:12:03.441573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:12:03.441573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:12:03.441573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:12:03.441573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53e773e1-f20a-476e-80a4-d6b769ee4004 could not be found. Aug 26 16:12:03.441573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:12:03.441573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:12:03.441573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:12:03.441573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:12:03.441573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:12:03.441573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:12:03.441573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:12:03.441573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:12:03.441573 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:12:03.443358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:12:03.443358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:12:03.443358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:12:03.443358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:12:03.443358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:12:03.443358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:12:03.443358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:12:03.443358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53e773e1-f20a-476e-80a4-d6b769ee4004 could not be found. Aug 26 16:12:03.443358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:12:03.443358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:12:03.443358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:12:03.443358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:12:03.443358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:12:03.443358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:12:03.443358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:12:03.443358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:12:03.443358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53e773e1-f20a-476e-80a4-d6b769ee4004 could not be found. Aug 26 16:12:03.443358 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:12:03.445116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-cb2af7eb-c91e-4e4f-8115-6d8fe9525975 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Returning 404 to user: Instance 53e773e1-f20a-476e-80a4-d6b769ee4004 could not be found. {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:12:03.445116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-cb2af7eb-c91e-4e4f-8115-6d8fe9525975 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004" status: 404 len: 111 microversion: 2.1 time: 0.031171 Aug 26 16:12:03.445116 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 657/1324] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:12:03 2022] GET /compute/v2.1/servers/53e773e1-f20a-476e-80a4-d6b769ee4004 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:12:03.967361 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-41edf1fe-9531-4353-87ab-4753b900da30 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:12:03.967886 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.compute.api [None req-41edf1fe-9531-4353-87ab-4753b900da30 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] Fetching instance by UUID {{(pid=128305) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:12:03.974503 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-41edf1fe-9531-4353-87ab-4753b900da30 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:12:03.975017 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-41edf1fe-9531-4353-87ab-4753b900da30 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:12:03.975452 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-41edf1fe-9531-4353-87ab-4753b900da30 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:12:03.976142 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-41edf1fe-9531-4353-87ab-4753b900da30 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:12:03.976594 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-41edf1fe-9531-4353-87ab-4753b900da30 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:12:03.977069 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG oslo_concurrency.lockutils [None req-41edf1fe-9531-4353-87ab-4753b900da30 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:12:03.991201 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.wsgi [None req-41edf1fe-9531-4353-87ab-4753b900da30 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] HTTP exception thrown: Instance 661129a9-294b-4425-ac84-500d92de2cc6 could not be found. Aug 26 16:12:03.992862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-41edf1fe-9531-4353-87ab-4753b900da30 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Request method failure captured: Aug 26 16:12:03.992862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: request: DELETE /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 HTTP/1.1 Aug 26 16:12:03.992862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept: application/json Aug 26 16:12:03.992862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Accept-Encoding: identity Aug 26 16:12:03.992862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Connection: close Aug 26 16:12:03.992862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Length: 0 Aug 26 16:12:03.992862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Content-Type: application/json Aug 26 16:12:03.992862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Host: 10.222.0.94 Aug 26 16:12:03.992862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: Openstack-System-Scope: None Aug 26 16:12:03.992862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: User-Agent: python-urllib3/1.26.11 Aug 26 16:12:03.992862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Auth-Token: gAAAAABjCO8kiDWM4vhVznoXwfR9MMqhXaAnXUM95N_VAGU8nUUvtlCXIPXxN2iNqstvUcM-VsO6rKcNS7Z80z_7oU4-jvse06U0FbaOF9gM4jljvLmV92GQj2QdWvoh7QTsLYK9UxEEA53VHKXRDgKFtbUwU9IvHnZxayI1b7d1-ia-ZnyaJw8 Aug 26 16:12:03.992862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Id: None Aug 26 16:12:03.992862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Domain-Name: None Aug 26 16:12:03.992862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Identity-Status: Confirmed Aug 26 16:12:03.992862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Is-Admin-Project: True Aug 26 16:12:03.992862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Id: default Aug 26 16:12:03.992862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Domain-Name: Default Aug 26 16:12:03.992862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Id: 3c5f0e0c02e64047b9ca17a7320b0bf5 Aug 26 16:12:03.992862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Project-Name: tempest-TestVolumeBootPattern-1888948582 Aug 26 16:12:03.992862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Role: member,reader Aug 26 16:12:03.992862 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Roles: member,reader Aug 26 16:12:03.994641 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3c5f0e0c02e64047b9ca17a7320b0bf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/3c5f0e0c02e64047b9ca17a7320b0bf5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3c5f0e0c02e64047b9ca17a7320b0bf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_3c5f0e0c02e64047b9ca17a7320b0bf5", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:12:03.994641 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant: tempest-TestVolumeBootPattern-1888948582 Aug 26 16:12:03.994641 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Id: 3c5f0e0c02e64047b9ca17a7320b0bf5 Aug 26 16:12:03.994641 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-Tenant-Name: tempest-TestVolumeBootPattern-1888948582 Aug 26 16:12:03.994641 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User: tempest-TestVolumeBootPattern-1888948582-project Aug 26 16:12:03.994641 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Id: default Aug 26 16:12:03.994641 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Domain-Name: Default Aug 26 16:12:03.994641 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Id: c911a9324cb744a6a1aeb068565d3f89 Aug 26 16:12:03.994641 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: X-User-Name: tempest-TestVolumeBootPattern-1888948582-project Aug 26 16:12:03.994641 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: method: > Aug 26 16:12:03.994641 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: exception: Instance 661129a9-294b-4425-ac84-500d92de2cc6 could not be found. Aug 26 16:12:03.994641 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: action_args: {'id': '661129a9-294b-4425-ac84-500d92de2cc6'} Aug 26 16:12:03.995789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:12:03.995789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:12:03.995789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:12:03.995789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:12:03.995789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:12:03.995789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:12:03.995789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:12:03.995789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:12:03.995789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:12:03.995789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:12:03.995789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 661129a9-294b-4425-ac84-500d92de2cc6 could not be found. Aug 26 16:12:03.995789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:12:03.995789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:12:03.995789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:12:03.995789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:12:03.995789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:12:03.995789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:12:03.995789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:12:03.995789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:12:03.995789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:12:03.997389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:12:03.997389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 16:12:03.997389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 16:12:03.997389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 16:12:03.997389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 16:12:03.997389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:12:03.997389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:12:03.997389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:12:03.997389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:12:03.997389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 661129a9-294b-4425-ac84-500d92de2cc6 could not be found. Aug 26 16:12:03.997389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:12:03.997389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:12:03.997389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:12:03.997389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:12:03.997389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:12:03.997389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:12:03.997389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:12:03.997389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:12:03.997389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 661129a9-294b-4425-ac84-500d92de2cc6 could not be found. Aug 26 16:12:03.997389 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: ERROR nova.api.openstack.wsgi Aug 26 16:12:03.998981 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-41edf1fe-9531-4353-87ab-4753b900da30 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Returning 404 to user: Instance 661129a9-294b-4425-ac84-500d92de2cc6 could not be found. {{(pid=128305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:12:03.998981 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-41edf1fe-9531-4353-87ab-4753b900da30 tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "DELETE /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6" status: 404 len: 111 microversion: 2.1 time: 0.030786 Aug 26 16:12:03.998981 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 668/1325] 10.222.0.94 () {58 vars in 1239 bytes} [Fri Aug 26 16:12:03 2022] DELETE /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:12:04.003797 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7c0e77c8-e11f-4bb9-a466-a5e35b04ecfd tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '>' {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:12:04.004410 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.compute.api [None req-7c0e77c8-e11f-4bb9-a466-a5e35b04ecfd tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] [instance: 661129a9-294b-4425-ac84-500d92de2cc6] Fetching instance by UUID {{(pid=128304) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 16:12:04.010378 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7c0e77c8-e11f-4bb9-a466-a5e35b04ecfd tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:12:04.010853 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7c0e77c8-e11f-4bb9-a466-a5e35b04ecfd tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:12:04.011324 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7c0e77c8-e11f-4bb9-a466-a5e35b04ecfd tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:12:04.012013 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7c0e77c8-e11f-4bb9-a466-a5e35b04ecfd tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Acquiring lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 16:12:04.012466 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7c0e77c8-e11f-4bb9-a466-a5e35b04ecfd tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 16:12:04.012891 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG oslo_concurrency.lockutils [None req-7c0e77c8-e11f-4bb9-a466-a5e35b04ecfd tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Lock "0b049a6f-4aea-43fa-a984-ec2d2c95e2da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 16:12:04.026253 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.wsgi [None req-7c0e77c8-e11f-4bb9-a466-a5e35b04ecfd tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] HTTP exception thrown: Instance 661129a9-294b-4425-ac84-500d92de2cc6 could not be found. Aug 26 16:12:04.028597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7c0e77c8-e11f-4bb9-a466-a5e35b04ecfd tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Request method failure captured: Aug 26 16:12:04.028597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: request: GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 HTTP/1.1 Aug 26 16:12:04.028597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept: application/json Aug 26 16:12:04.028597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Accept-Encoding: identity Aug 26 16:12:04.028597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Connection: close Aug 26 16:12:04.028597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Length: 0 Aug 26 16:12:04.028597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Content-Type: application/json Aug 26 16:12:04.028597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Host: 10.222.0.94 Aug 26 16:12:04.028597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: Openstack-System-Scope: None Aug 26 16:12:04.028597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: User-Agent: python-urllib3/1.26.11 Aug 26 16:12:04.028597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Auth-Token: gAAAAABjCO8kiDWM4vhVznoXwfR9MMqhXaAnXUM95N_VAGU8nUUvtlCXIPXxN2iNqstvUcM-VsO6rKcNS7Z80z_7oU4-jvse06U0FbaOF9gM4jljvLmV92GQj2QdWvoh7QTsLYK9UxEEA53VHKXRDgKFtbUwU9IvHnZxayI1b7d1-ia-ZnyaJw8 Aug 26 16:12:04.028597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Id: None Aug 26 16:12:04.028597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Domain-Name: None Aug 26 16:12:04.028597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Identity-Status: Confirmed Aug 26 16:12:04.028597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Is-Admin-Project: True Aug 26 16:12:04.028597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Id: default Aug 26 16:12:04.028597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Domain-Name: Default Aug 26 16:12:04.028597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Id: 3c5f0e0c02e64047b9ca17a7320b0bf5 Aug 26 16:12:04.028597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Project-Name: tempest-TestVolumeBootPattern-1888948582 Aug 26 16:12:04.028597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Role: member,reader Aug 26 16:12:04.028597 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Roles: member,reader Aug 26 16:12:04.030346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3c5f0e0c02e64047b9ca17a7320b0bf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/3c5f0e0c02e64047b9ca17a7320b0bf5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3c5f0e0c02e64047b9ca17a7320b0bf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:8080/v1/AUTH_3c5f0e0c02e64047b9ca17a7320b0bf5", "adminURL": "http://10.222.0.94:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}] Aug 26 16:12:04.030346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant: tempest-TestVolumeBootPattern-1888948582 Aug 26 16:12:04.030346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Id: 3c5f0e0c02e64047b9ca17a7320b0bf5 Aug 26 16:12:04.030346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-Tenant-Name: tempest-TestVolumeBootPattern-1888948582 Aug 26 16:12:04.030346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User: tempest-TestVolumeBootPattern-1888948582-project Aug 26 16:12:04.030346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Id: default Aug 26 16:12:04.030346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Domain-Name: Default Aug 26 16:12:04.030346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Id: c911a9324cb744a6a1aeb068565d3f89 Aug 26 16:12:04.030346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: X-User-Name: tempest-TestVolumeBootPattern-1888948582-project Aug 26 16:12:04.030346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: method: > Aug 26 16:12:04.030346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: exception: Instance 661129a9-294b-4425-ac84-500d92de2cc6 could not be found. Aug 26 16:12:04.030346 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: action_args: {'id': '661129a9-294b-4425-ac84-500d92de2cc6'} Aug 26 16:12:04.031956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: {{(pid=128304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 16:12:04.031956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:12:04.031956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 16:12:04.031956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 16:12:04.031956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 16:12:04.031956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 16:12:04.031956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 16:12:04.031956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 16:12:04.031956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 16:12:04.031956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 16:12:04.031956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 661129a9-294b-4425-ac84-500d92de2cc6 could not be found. Aug 26 16:12:04.031956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:12:04.031956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:12:04.031956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:12:04.031956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:12:04.031956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:12:04.031956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:12:04.031956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 16:12:04.031956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 16:12:04.031956 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 16:12:04.033655 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 16:12:04.033655 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 16:12:04.033655 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 16:12:04.033655 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 16:12:04.033655 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 16:12:04.033655 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 16:12:04.033655 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 16:12:04.033655 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 661129a9-294b-4425-ac84-500d92de2cc6 could not be found. Aug 26 16:12:04.033655 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:12:04.033655 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 16:12:04.033655 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:12:04.033655 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 16:12:04.033655 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 16:12:04.033655 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 16:12:04.033655 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 16:12:04.033655 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 16:12:04.033655 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 661129a9-294b-4425-ac84-500d92de2cc6 could not be found. Aug 26 16:12:04.033655 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: ERROR nova.api.openstack.wsgi Aug 26 16:12:04.035203 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: DEBUG nova.api.openstack.wsgi [None req-7c0e77c8-e11f-4bb9-a466-a5e35b04ecfd tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Returning 404 to user: Instance 661129a9-294b-4425-ac84-500d92de2cc6 could not be found. {{(pid=128304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 16:12:04.035203 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: INFO nova.api.openstack.requestlog [None req-7c0e77c8-e11f-4bb9-a466-a5e35b04ecfd tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6" status: 404 len: 111 microversion: 2.1 time: 0.030873 Aug 26 16:12:04.035203 dv-cinder-851449-7-iscsi devstack@n-api.service[128304]: [pid: 128304|app: 0|req: 658/1326] 10.222.0.94 () {58 vars in 1236 bytes} [Fri Aug 26 16:12:03 2022] GET /compute/v2.1/servers/661129a9-294b-4425-ac84-500d92de2cc6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 16:12:05.443583 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: DEBUG nova.api.openstack.wsgi [None req-15b4502a-5df7-4f19-9707-b9d597f6cc4a tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] Calling method '.version_select at 0x7f15dcd650d0>' {{(pid=128305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 16:12:05.523789 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: INFO nova.api.openstack.requestlog [None req-15b4502a-5df7-4f19-9707-b9d597f6cc4a tempest-TestVolumeBootPattern-1888948582 tempest-TestVolumeBootPattern-1888948582-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1864094508" status: 202 len: 0 microversion: 2.1 time: 0.084383 Aug 26 16:12:05.524487 dv-cinder-851449-7-iscsi devstack@n-api.service[128305]: [pid: 128305|app: 0|req: 669/1327] 10.222.0.94 () {58 vars in 1263 bytes} [Fri Aug 26 16:12:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1864094508 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)